Apr 09 16:46:40 devstack cinder-volume[72295]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 16:46:40 devstack cinder-volume[72295]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 16:46:40 devstack cinder-volume[72295]: we strongly recommend against using it for new projects. Apr 09 16:46:40 devstack cinder-volume[72295]: If you are already using Eventlet, we recommend migrating to a different Apr 09 16:46:40 devstack cinder-volume[72295]: framework. For more detail see Apr 09 16:46:40 devstack cinder-volume[72295]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 16:46:40 devstack cinder-volume[72295]: import eventlet # noqa Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 16:46:42 devstack cinder-volume[72295]: INFO dbcounter [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Registered counter for database cinder Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG oslo_db.sqlalchemy.engines [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG dbcounter [-] [72295] Writer thread running {{(pid=72295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 16:46:42 devstack cinder-volume[72295]: INFO cinder.rpc [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 16:46:42 devstack cinder-volume[72295]: INFO cinder.rpc [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG oslo_db.sqlalchemy.engines [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:46:42 devstack cinder-volume[72295]: INFO cinder.volume.manager [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Determined volume DB was empty at startup. Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG cinder.volume.manager [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72295) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 16:46:42 devstack cinder-volume[72295]: INFO cinder.volume.manager [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 09 16:46:42 devstack cinder-volume[72295]: WARNING stevedore.named [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 16:46:42 devstack cinder-volume[72295]: WARNING castellan.key_manager [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 16:46:42 devstack cinder-volume[72295]: WARNING cinder.keymgr.conf_key_mgr [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG cinder.volume.drivers.lvm [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72295) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 09 16:46:42 devstack cinder-volume[72295]: DEBUG oslo_concurrency.processutils [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_concurrency.processutils [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] CMD "cinder-rtstool verify" returned: 0 in 0.276s {{(pid=72295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_db.sqlalchemy.engines [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:46:43 devstack cinder-volume[72295]: INFO cinder.rpc [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 09 16:46:43 devstack cinder-volume[72295]: INFO cinder.rpc [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 09 16:46:43 devstack cinder-volume[72295]: WARNING stevedore.named [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 16:46:43 devstack cinder-volume[72295]: WARNING castellan.key_manager [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 16:46:43 devstack cinder-volume[72295]: INFO cinder.volume.manager [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_db.sqlalchemy.engines [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:46:43 devstack cinder-volume[72295]: INFO oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Starting 1 workers Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Started child 72400 {{(pid=72295) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Full set of CONF: {{(pid=72295) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] ******************************************************************************** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Configuration options gathered from: {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] ================================================================================ {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] allow_availability_zone_fallback = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] allow_compression_on_image_upload = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] allowed_direct_url_schemes = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] api_rate_limit = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] auth_strategy = keystone {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] az_cache_duration = 3600 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_availability_zone = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_host = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_stats_polling_interval = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backup_api_class = cinder.backup.api.API {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backup_name_template = backup-%s {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backup_use_same_host = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backup_use_temp_snapshot = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] chap_password = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] chap_username = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_internal_tenant_project_id = cdae92d9ad234a9bb88336b9e4f55ad8 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_internal_tenant_user_id = d9cef06baf1d4f2eac67229a20698f7f {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cloned_volume_same_az = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cluster = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] compression_format = gzip {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] compute_api_class = cinder.compute.nova.API {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] config_dir = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] config_source = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] control_exchange = openstack {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] debug = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] default_availability_zone = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] default_group_type = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72400]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] default_volume_type = lvmdriver-1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] disk_geometry = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] driver_client_cert = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] driver_client_cert_key = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] driver_data_namespace = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] driver_ssl_cert_path = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] driver_ssl_cert_verify = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] driver_use_ssl = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] enable_force_upload = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] enable_new_services = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] enable_unsupported_driver = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] enforce_multipath_for_image_xfer = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] filter_function = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_api_insecure = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_api_servers = ['http://192.168.122.252/image'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_api_ssl_compression = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_ca_certificates_file = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_catalog_info = image:glance:publicURL {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_certfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_keyfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_num_retries = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance_request_timeout = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] goodness_function = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] graceful_shutdown_timeout = 5 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] group_api_class = cinder.group.api.API {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] host = devstack {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_compress_on_upload = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_conversion_address_space_limit = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_conversion_cpu_limit = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_conversion_disable = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_upload_use_cinder_backend = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_upload_use_internal_tenant = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_volume_cache_enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_volume_cache_max_count = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] image_volume_cache_max_size_gb = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] init_host_max_objects_retrieval = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] instance_format = [instance: %(uuid)s] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] iscsi_target_flags = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] iscsi_write_cache = on {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] iser_helper = tgtadm {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] iser_ip_address = 192.168.122.252 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] iser_port = 3260 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_color = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_config_append = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_dir = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_file = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_options = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_rotate_interval = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_rotate_interval_type = days {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] log_rotation_type = none {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] max_age = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] max_logfile_count = 30 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] max_logfile_size_mb = 200 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] max_over_subscription_ratio = 20.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] message_reap_interval = 86400 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] message_ttl = 2592000 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] migration_create_volume_timeout_secs = 300 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] monkey_patch = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] monkey_patch_modules = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] my_ip = 192.168.122.252 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] no_snapshot_gb_quota = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] num_iser_scan_tries = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] num_shell_tries = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] num_volume_device_scan_tries = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] nvmeof_conn_info_version = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] nvmet_ns_id = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] nvmet_port_id = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] osapi_max_limit = 1000 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] osapi_volume_ext_list = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] osapi_volume_listen_port = 8776 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] osapi_volume_use_ssl = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] osapi_volume_workers = 2 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] per_volume_size_limit = -1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] periodic_fuzzy_delay = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] periodic_interval = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] public_endpoint = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] publish_errors = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] quota_backup_gigabytes = 1000 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] quota_backups = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] quota_gigabytes = 1000 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] quota_groups = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] quota_snapshots = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] quota_volumes = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] rate_limit_burst = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] rate_limit_except_level = CRITICAL {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] rate_limit_interval = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] reinit_driver_count = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] replication_device = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] report_discard_supported = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] report_interval = 120 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] reservation_clean_interval = 86400 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] reservation_expire = 86400 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] reserved_image_namespaces = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] reserved_percentage = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] rpc_response_timeout = 120 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] run_external_periodic_tasks = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] scst_target_driver = iscsi {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] scst_target_iqn_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_down_time = 720 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] shell_completion = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] snapshot_name_template = snapshot-%s {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] snapshot_same_host = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] split_loggers = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] state_path = /opt/stack/data/cinder {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] storage_availability_zone = nova {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] storage_protocol = iSCSI {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] syslog_log_facility = LOG_USER {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] target_helper = lioadm {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] target_ip_address = 192.168.122.252 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] target_port = 3260 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] target_protocol = iscsi {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] target_secondary_ip_addresses = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] trace_flags = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] transport_url = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] until_refresh = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] use_chap_auth = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] use_default_quota_class = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] use_journal = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] use_json = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] use_multipath_for_image_xfer = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] use_stderr = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] use_syslog = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] verify_glance_signatures = enabled {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_api_class = cinder.volume.api.API {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_backend_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_clear = zero {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_clear_ionice = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_clear_size = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_copy_bps_limit = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_dd_blocksize = 1M {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_name_template = volume-%s {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_service_inithost_offload = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volume_usage_audit_period = month {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] zoning_mode = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_concurrency.disable_process_locking = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.admin_password = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.admin_token = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.admin_user = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.auth_port = 35357 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.auth_protocol = https {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.auth_section = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.auth_type = password {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.auth_uri = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.auth_version = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.cache = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.certfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.identity_uri = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.include_service_catalog = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.insecure = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.interface = public {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.keyfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_password = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcache_username = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.region_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.service_type = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.backend = dogpile.cache.null {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.backend_argument = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.backend_expiration_time = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.config_prefix = cache.oslo {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.debug_cache_backend = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.enable_retry_client = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.enable_socket_keepalive = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.enforce_fips_mode = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.expiration_time = 600 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.hashclient_retry_attempts = 2 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.memcache_dead_retry = 300 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.memcache_pool_maxsize = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.memcache_sasl_enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.password = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.proxies = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.redis_db = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.redis_server = localhost:6379 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.retry_attempts = 2 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.retry_delay = 0.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.socket_keepalive_count = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.socket_keepalive_idle = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.socket_keepalive_interval = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.socket_timeout = 1.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.tls_allowed_ciphers = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.tls_cafile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.tls_certfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.tls_enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.tls_keyfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cache.username = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] coordination.backend_url = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.asyncio_connection = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.asyncio_slave_connection = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.backend = sqlalchemy {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.connection = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.connection_debug = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.connection_parameters = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.connection_recycle_time = 3600 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.connection_trace = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.db_inc_retry_interval = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.db_max_retries = 20 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.db_max_retry_interval = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.db_retry_interval = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.max_overflow = 50 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.max_pool_size = 5 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.max_retries = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.mysql_wsrep_sync_wait = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.pool_timeout = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.retry_interval = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.slave_connection = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.sqlite_synchronous = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.synchronous_reader = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] database.use_db_reconnect = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.connection_string = messaging:// {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.es_doc_type = notification {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.es_scroll_size = 10000 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.es_scroll_time = 2m {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.filter_error_trace = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.hmac_keys = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.sentinel_service_name = mymaster {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.socket_timeout = 0.1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.trace_requests = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler.trace_sqlalchemy = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler_jaeger.process_tags = {} {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler_jaeger.service_name_prefix = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] profiler_otlp.service_name_prefix = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.enforce_new_defaults = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: WARNING oslo_config.cfg [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.enforce_scope = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.policy_default_rule = default {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.policy_file = policy.yaml {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] privsep_osbrick.group = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] privsep_osbrick.helper_command = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] privsep_osbrick.user = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_sys_admin.group = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_sys_admin.helper_command = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] cinder_sys_admin.user = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.auth_section = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.auth_type = password {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.cafile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.certfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.collect_timing = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.insecure = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.keyfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.send_service_user_token = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.split_loggers = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] service_user.timeout = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.auth_section = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.auth_type = password {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.certfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.collect_timing = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.insecure = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.keyfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.region_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.split_loggers = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] glance.timeout = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.backend_availability_zone = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.chap_password = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.chap_username = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.disk_geometry = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.driver_client_cert = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.driver_client_cert_key = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.driver_data_namespace = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.driver_use_ssl = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.extra_capabilities = {} {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.filter_function = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.goodness_function = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.iscsi_target_flags = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.iscsi_write_cache = on {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.iser_helper = tgtadm {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.iser_port = 3260 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.lvm_share_target = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.lvm_type = auto {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.num_shell_tries = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.replication_device = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.report_discard_supported = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.reserved_percentage = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.target_helper = tgtadm {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.target_port = 3260 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.target_protocol = iscsi {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.trace_flags = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.unique_fqdn_network = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.use_chap_auth = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_backend_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_clear = zero {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_clear_ionice = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_clear_size = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_reports.file_event_handler = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_reports.log_dir = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.backend_host = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.chap_password = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.chap_username = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.disk_geometry = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.driver_client_cert = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.extra_capabilities = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.filter_function = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.goodness_function = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.iser_helper = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.iser_ip_address = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.iser_port = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.lvm_share_target = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.lvm_type = auto {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.num_shell_tries = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.replication_device = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.report_discard_supported = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.reserved_percentage = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.scst_target_driver = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.storage_protocol = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.target_helper = lioadm {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.target_ip_address = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.target_port = 3260 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.trace_flags = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.use_chap_auth = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_clear = zero {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_clear_size = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] lvmdriver-1.volumes_dir = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.ssl = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_notifications.driver = [] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_notifications.retry = -1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] key_manager.fixed_key = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72400]: INFO cinder.volume.manager [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.barbican_api_version = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.barbican_endpoint = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.barbican_endpoint_type = public {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.barbican_region_name = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.cafile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.certfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.collect_timing = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.insecure = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.keyfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.number_of_retries = 60 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.retry_delay = 1 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.send_service_user_token = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.split_loggers = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.timeout = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.verify_ssl = True {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican.verify_ssl_path = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.auth_section = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.auth_type = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.cafile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.certfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.collect_timing = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.insecure = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.keyfile = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.split_loggers = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] barbican_service_user.timeout = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.approle_role_id = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.approle_secret_id = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.kv_mountpoint = secret {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.kv_path = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.kv_version = 2 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.namespace = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.root_token_id = **** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.ssl_ca_crt_file = None {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.timeout = 60.0 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.use_ssl = False {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:46:43 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] ******************************************************************************** {{(pid=72295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 16:46:43 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:43 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:43 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:43 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:43 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:43 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:43 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:43 devstack sudo[72404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 09 16:46:43 devstack sudo[72404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:44 devstack sudo[72404]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:44 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:44 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:44 devstack sudo[72498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:44 devstack sudo[72498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:44 devstack sudo[72498]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:44 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.493s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:44 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:46:44 devstack cinder-volume[72400]: INFO cinder.brick.local_dev.lvm [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 09 16:46:44 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:44 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:44 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:44 devstack sudo[72722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:46:44 devstack sudo[72722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:45 devstack sudo[72722]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:45 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:45 devstack cinder-volume[72400]: DEBUG cinder.brick.local_dev.lvm [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72400) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 09 16:46:45 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:45 devstack sudo[72894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:45 devstack sudo[72894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:46 devstack sudo[72894]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:46 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.002s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:46 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:46 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:46 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:46 devstack sudo[73094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:46 devstack sudo[73094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:46 devstack sudo[73094]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:46 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:46 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:46 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:46 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:46 devstack sudo[73099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 09 16:46:46 devstack sudo[73099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:47 devstack sudo[73099]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:47 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.448s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:47 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:47 devstack sudo[73102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:46:47 devstack sudo[73102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:47 devstack sudo[73102]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:47 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:47 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:47 devstack sudo[73107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:46:47 devstack sudo[73107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:47 devstack sudo[73107]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:47 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:47 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:47 devstack sudo[73113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:46:47 devstack sudo[73113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:48 devstack sudo[73113]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:48 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:48 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:48 devstack sudo[73119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:48 devstack sudo[73119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:48 devstack sudo[73119]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:48 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:48 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:48 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:48 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:48 devstack sudo[73123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:48 devstack sudo[73123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:49 devstack sudo[73123]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:49 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:49 devstack cinder-volume[72400]: INFO cinder.volume.drivers.lvm [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 09 16:46:49 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:49 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:49 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:49 devstack sudo[73147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:49 devstack sudo[73147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:49 devstack sudo[73147]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:49 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:49 devstack cinder-volume[72400]: DEBUG cinder.volume.drivers.lvm [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Updating volume stats {{(pid=72400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 16:46:49 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:49 devstack sudo[73248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:46:49 devstack sudo[73248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:50 devstack sudo[73248]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:50 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:50 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:50 devstack sudo[73252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:46:50 devstack sudo[73252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:50 devstack sudo[73252]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:50 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:50 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:50 devstack sudo[73390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:50 devstack sudo[73390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:51 devstack sudo[73390]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:51 devstack sudo[73396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:46:51 devstack sudo[73396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:51 devstack sudo[73396]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:51 devstack cinder-volume[72400]: INFO cinder.volume.driver [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Driver hasn't implemented _init_vendor_properties() Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG cinder.volume.driver [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72400) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG oslo_db.sqlalchemy.engines [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72400) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG dbcounter [-] [72400] Writer thread running {{(pid=72400) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG cinder.db.sqlalchemy.api [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Building query based on filter {{(pid=72400) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG cinder.image.image_utils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72400) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 16:46:51 devstack cinder-volume[72400]: INFO cinder.keymgr.migration [None req-9593bfec-46d1-438f-8463-0a4374d9b659 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG cinder.volume.drivers.lvm [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Updating volume stats {{(pid=72400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 16:46:51 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:51 devstack sudo[73403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:46:51 devstack sudo[73403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:52 devstack sudo[73403]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:52 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:52 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:52 devstack sudo[73406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:46:52 devstack sudo[73406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:52 devstack sudo[73406]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:52 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:52 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:52 devstack sudo[73409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:52 devstack sudo[73409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:53 devstack sudo[73409]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:53 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.490s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:53 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:53 devstack sudo[73414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:46:53 devstack sudo[73414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:53 devstack cinder-volume[72295]: DEBUG dbcounter [-] [72295] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:46:53 devstack sudo[73414]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:53 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:53 devstack cinder-volume[72400]: DEBUG cinder.manager [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Notifying Schedulers of capabilities ... {{(pid=72400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:46:53 devstack cinder-volume[72400]: INFO cinder.volume.manager [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Driver initialization completed successfully. Apr 09 16:46:53 devstack cinder-volume[72400]: INFO cinder.manager [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Initiating service 2 cleanup Apr 09 16:46:53 devstack cinder-volume[72400]: INFO cinder.manager [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Service 2 cleanup completed. Apr 09 16:46:53 devstack cinder-volume[72400]: DEBUG cinder.service [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Creating RPC server for service cinder-volume {{(pid=72400) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 16:46:53 devstack cinder-volume[72400]: DEBUG cinder.service [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72400) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 16:46:53 devstack cinder-volume[72400]: INFO cinder.volume.manager [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 09 16:46:53 devstack cinder-volume[72400]: DEBUG cinder.volume.drivers.lvm [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Updating volume stats {{(pid=72400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 16:46:53 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:53 devstack sudo[73423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:46:53 devstack sudo[73423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:54 devstack sudo[73423]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:54 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.545s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:54 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:54 devstack sudo[73426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:46:54 devstack sudo[73426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:54 devstack sudo[73426]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:54 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:54 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:54 devstack sudo[73483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:46:54 devstack sudo[73483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:55 devstack sudo[73483]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.472s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:46:55 devstack sudo[73486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:46:55 devstack sudo[73486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:46:55 devstack sudo[73486]: pam_unix(sudo:session): session closed for user root Apr 09 16:46:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:46:55 devstack cinder-volume[72400]: INFO cinder.volume.manager [None req-6e09dd72-1a8b-4e7f-8a5d-60c3136b2d4a None None] Driver post RPC initialization completed successfully. Apr 09 16:47:05 devstack cinder-volume[72400]: DEBUG dbcounter [-] [72400] Writing DB stats cinder:SELECT=2 {{(pid=72400) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:47:05 devstack cinder-volume[72400]: DEBUG dbcounter [-] [72400] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72400) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:47:54 devstack cinder-volume[72400]: DEBUG oslo_service.periodic_task [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72400) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:47:54 devstack cinder-volume[72400]: DEBUG cinder.volume.drivers.lvm [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Updating volume stats {{(pid=72400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 16:47:54 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:47:54 devstack sudo[78220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:47:54 devstack sudo[78220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:47:55 devstack sudo[78220]: pam_unix(sudo:session): session closed for user root Apr 09 16:47:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:47:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:47:55 devstack sudo[78223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:47:55 devstack sudo[78223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:47:55 devstack sudo[78223]: pam_unix(sudo:session): session closed for user root Apr 09 16:47:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:47:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:47:55 devstack sudo[78227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:47:55 devstack sudo[78227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:47:55 devstack sudo[78227]: pam_unix(sudo:session): session closed for user root Apr 09 16:47:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.413s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:47:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:47:55 devstack sudo[78230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:47:55 devstack sudo[78230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:47:56 devstack sudo[78230]: pam_unix(sudo:session): session closed for user root Apr 09 16:47:56 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:47:56 devstack cinder-volume[72400]: DEBUG cinder.manager [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Notifying Schedulers of capabilities ... {{(pid=72400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:48:54 devstack cinder-volume[72400]: DEBUG oslo_service.periodic_task [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72400) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:48:54 devstack cinder-volume[72400]: DEBUG cinder.volume.drivers.lvm [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Updating volume stats {{(pid=72400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 16:48:54 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:48:54 devstack sudo[79396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:48:54 devstack sudo[79396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:48:55 devstack sudo[79396]: pam_unix(sudo:session): session closed for user root Apr 09 16:48:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:48:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:48:55 devstack sudo[79419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:48:55 devstack sudo[79419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:48:55 devstack sudo[79419]: pam_unix(sudo:session): session closed for user root Apr 09 16:48:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:48:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:48:55 devstack sudo[79442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:48:55 devstack sudo[79442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:48:55 devstack sudo[79442]: pam_unix(sudo:session): session closed for user root Apr 09 16:48:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:48:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:48:55 devstack sudo[79459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:48:55 devstack sudo[79459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:48:56 devstack sudo[79459]: pam_unix(sudo:session): session closed for user root Apr 09 16:48:56 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:48:56 devstack cinder-volume[72400]: DEBUG cinder.manager [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Notifying Schedulers of capabilities ... {{(pid=72400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:49:05 devstack cinder-volume[72400]: DEBUG dbcounter [-] [72400] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72400) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:49:54 devstack cinder-volume[72400]: DEBUG oslo_service.periodic_task [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72400) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:49:54 devstack cinder-volume[72400]: DEBUG cinder.volume.drivers.lvm [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Updating volume stats {{(pid=72400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 16:49:54 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:49:54 devstack sudo[81082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 16:49:54 devstack sudo[81082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:49:55 devstack sudo[81082]: pam_unix(sudo:session): session closed for user root Apr 09 16:49:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.411s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:49:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:49:55 devstack sudo[81085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:49:55 devstack sudo[81085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:49:55 devstack sudo[81085]: pam_unix(sudo:session): session closed for user root Apr 09 16:49:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:49:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:49:55 devstack sudo[81099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 16:49:55 devstack sudo[81099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:49:55 devstack sudo[81099]: pam_unix(sudo:session): session closed for user root Apr 09 16:49:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.423s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:49:55 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:49:55 devstack sudo[81102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 16:49:55 devstack sudo[81102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:49:56 devstack sudo[81102]: pam_unix(sudo:session): session closed for user root Apr 09 16:49:56 devstack cinder-volume[72400]: DEBUG oslo_concurrency.processutils [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:49:56 devstack cinder-volume[72400]: DEBUG cinder.manager [None req-0d65b63a-129c-49e1-bd4f-5312671633c0 None None] Notifying Schedulers of capabilities ... {{(pid=72400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:50:11 devstack cinder-volume[72295]: INFO oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Caught SIGTERM, stopping children Apr 09 16:50:11 devstack cinder-volume[72295]: DEBUG oslo_concurrency.lockutils [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Acquiring lock "singleton_lock" {{(pid=72295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 16:50:11 devstack cinder-volume[72295]: DEBUG oslo_concurrency.lockutils [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Acquired lock "singleton_lock" {{(pid=72295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 16:50:11 devstack cinder-volume[72295]: DEBUG oslo_concurrency.lockutils [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Releasing lock "singleton_lock" {{(pid=72295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 16:50:11 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Stop services. {{(pid=72295) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 09 16:50:11 devstack cinder-volume[72295]: DEBUG oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Killing children. {{(pid=72295) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 09 16:50:11 devstack cinder-volume[72295]: INFO oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Waiting on 1 children to exit Apr 09 16:50:13 devstack cinder-volume[72400]: DEBUG oslo_concurrency.lockutils [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Acquiring lock "singleton_lock" {{(pid=72400) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 16:50:13 devstack cinder-volume[72400]: DEBUG oslo_concurrency.lockutils [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Acquired lock "singleton_lock" {{(pid=72400) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 16:50:13 devstack cinder-volume[72400]: DEBUG oslo_concurrency.lockutils [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Releasing lock "singleton_lock" {{(pid=72400) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 16:50:13 devstack cinder-volume[72400]: WARNING amqp [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 16:50:13 devstack cinder-volume[72400]: WARNING amqp [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 16:50:13 devstack cinder-volume[72295]: INFO oslo_service.backend._eventlet.service [None req-90df5f31-a20b-43ea-9926-d3ff8d0e3315 None None] Child 72400 exited with status 0 Apr 09 16:50:13 devstack cinder-volume[81618]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 16:50:13 devstack cinder-volume[81618]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 16:50:13 devstack cinder-volume[81618]: we strongly recommend against using it for new projects. Apr 09 16:50:13 devstack cinder-volume[81618]: If you are already using Eventlet, we recommend migrating to a different Apr 09 16:50:13 devstack cinder-volume[81618]: framework. For more detail see Apr 09 16:50:13 devstack cinder-volume[81618]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 16:50:13 devstack cinder-volume[81618]: import eventlet # noqa Apr 09 16:50:15 devstack cinder-volume[81618]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 16:50:15 devstack cinder-volume[81618]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 16:50:15 devstack cinder-volume[81618]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 16:50:16 devstack cinder-volume[81618]: INFO dbcounter [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Registered counter for database cinder Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_db.sqlalchemy.engines [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG dbcounter [-] [81618] Writer thread running {{(pid=81618) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 16:50:16 devstack cinder-volume[81618]: INFO cinder.rpc [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 16:50:16 devstack cinder-volume[81618]: INFO cinder.rpc [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_db.sqlalchemy.engines [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:50:16 devstack cinder-volume[81618]: INFO cinder.volume.manager [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Determined volume DB was empty at startup. Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG cinder.volume.manager [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81618) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 16:50:16 devstack cinder-volume[81618]: INFO cinder.volume.manager [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 09 16:50:16 devstack cinder-volume[81618]: WARNING stevedore.named [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 16:50:16 devstack cinder-volume[81618]: WARNING castellan.key_manager [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 16:50:16 devstack cinder-volume[81618]: WARNING cinder.keymgr.conf_key_mgr [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 16:50:16 devstack cinder-volume[81618]: INFO cinder.volume.manager [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_db.sqlalchemy.engines [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:50:16 devstack cinder-volume[81618]: INFO oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Starting 1 workers Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Started child 81736 {{(pid=81618) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Full set of CONF: {{(pid=81618) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] ******************************************************************************** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Configuration options gathered from: {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] ================================================================================ {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] allow_availability_zone_fallback = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81736]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] allow_compression_on_image_upload = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] allowed_direct_url_schemes = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] api_rate_limit = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] auth_strategy = keystone {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_availability_zone = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_host = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_stats_polling_interval = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backup_api_class = cinder.backup.api.API {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backup_name_template = backup-%s {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backup_use_same_host = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backup_use_temp_snapshot = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] chap_password = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] chap_username = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_internal_tenant_project_id = cdae92d9ad234a9bb88336b9e4f55ad8 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_internal_tenant_user_id = d9cef06baf1d4f2eac67229a20698f7f {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cluster = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] compression_format = gzip {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] compute_api_class = cinder.compute.nova.API {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] config_dir = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] config_source = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] control_exchange = openstack {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] debug = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] default_availability_zone = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] default_group_type = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] default_volume_type = QuobyteHD {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] disk_geometry = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] driver_client_cert = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] driver_client_cert_key = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] driver_data_namespace = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] driver_ssl_cert_path = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] driver_ssl_cert_verify = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] driver_use_ssl = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] enable_new_services = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] enable_unsupported_driver = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] enabled_backends = ['QuobyteHD'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] enforce_multipath_for_image_xfer = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] filter_function = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_api_insecure = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_api_servers = ['http://192.168.122.252/image'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_api_ssl_compression = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_ca_certificates_file = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_catalog_info = image:glance:publicURL {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_certfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_keyfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_num_retries = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance_request_timeout = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] goodness_function = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] graceful_shutdown_timeout = 5 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] group_api_class = cinder.group.api.API {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] host = devstack {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_compress_on_upload = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_conversion_address_space_limit = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_conversion_cpu_limit = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_conversion_disable = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_upload_use_cinder_backend = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_upload_use_internal_tenant = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_volume_cache_enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_volume_cache_max_count = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] image_volume_cache_max_size_gb = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] init_host_max_objects_retrieval = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] instance_format = [instance: %(uuid)s] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] iscsi_target_flags = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] iscsi_write_cache = on {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] iser_helper = tgtadm {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] iser_ip_address = 192.168.122.252 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] iser_port = 3260 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_color = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_config_append = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_dir = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_file = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_options = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_rotate_interval = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_rotate_interval_type = days {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] log_rotation_type = none {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81736]: INFO cinder.volume.manager [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81736]: DEBUG cinder.volume.drivers.remotefs [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81736) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] max_age = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] max_logfile_count = 30 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] max_logfile_size_mb = 200 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] max_over_subscription_ratio = 20.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] message_reap_interval = 86400 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] message_ttl = 2592000 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] migration_create_volume_timeout_secs = 300 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] monkey_patch = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] monkey_patch_modules = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] my_ip = 192.168.122.252 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] no_snapshot_gb_quota = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] num_iser_scan_tries = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] num_shell_tries = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] num_volume_device_scan_tries = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] nvmeof_conn_info_version = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] nvmet_ns_id = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] nvmet_port_id = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] osapi_max_limit = 1000 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] osapi_volume_ext_list = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] osapi_volume_listen = 0.0.0.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] osapi_volume_listen_port = 8776 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] osapi_volume_use_ssl = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] osapi_volume_workers = 2 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] per_volume_size_limit = -1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] periodic_fuzzy_delay = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] periodic_interval = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] project_id_regex = [0-9a-f\-]+ {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] public_endpoint = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] publish_errors = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] quota_backup_gigabytes = 1000 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] quota_backups = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] quota_gigabytes = 1000 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] quota_groups = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] quota_snapshots = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] quota_volumes = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] rate_limit_burst = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] rate_limit_except_level = CRITICAL {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] rate_limit_interval = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] reinit_driver_count = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] replication_device = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] report_discard_supported = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] report_interval = 120 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] reservation_clean_interval = 86400 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] reservation_expire = 86400 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] reserved_image_namespaces = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] reserved_percentage = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] rpc_response_timeout = 120 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] run_external_periodic_tasks = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] scst_target_driver = iscsi {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] scst_target_iqn_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_down_time = 720 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] shell_completion = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] snapshot_name_template = snapshot-%s {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] split_loggers = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] state_path = /opt/stack/data/cinder {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] storage_availability_zone = nova {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] storage_protocol = iSCSI {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] syslog_log_facility = LOG_USER {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] target_helper = lioadm {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] target_ip_address = 192.168.122.252 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] target_port = 3260 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] target_protocol = iscsi {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] target_secondary_ip_addresses = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] trace_flags = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] transfer_api_class = cinder.transfer.api.API {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] transport_url = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] until_refresh = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] use_chap_auth = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] use_default_quota_class = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] use_journal = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] use_json = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] use_multipath_for_image_xfer = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] use_stderr = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] use_syslog = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] verify_glance_signatures = enabled {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_api_class = cinder.volume.api.API {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_backend_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_clear = zero {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_clear_ionice = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_clear_size = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_copy_bps_limit = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_dd_blocksize = 1M {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_name_template = volume-%s {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_service_inithost_offload = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volume_usage_audit_period = month {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] zoning_mode = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_concurrency.disable_process_locking = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.admin_password = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.admin_token = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.admin_user = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.auth_admin_prefix = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.auth_port = 35357 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.auth_protocol = https {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.auth_section = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.auth_type = password {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.auth_uri = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.auth_version = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.cache = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.certfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.delay_auth_decision = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.http_connect_timeout = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.identity_uri = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.include_service_catalog = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.insecure = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.interface = public {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.keyfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_password = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81736) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 09 16:50:16 devstack cinder-volume[81736]: WARNING cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: WARNING cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Running cmd (subprocess): mount.quobyte {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcache_username = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.region_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.service_token_roles_required = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.service_type = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.token_cache_time = 300 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.backend = dogpile.cache.null {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.backend_argument = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.backend_expiration_time = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.config_prefix = cache.oslo {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.debug_cache_backend = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.enable_retry_client = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.enable_socket_keepalive = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.enforce_fips_mode = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.expiration_time = 600 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.hashclient_retry_attempts = 2 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.memcache_dead_retry = 300 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.memcache_pool_maxsize = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.memcache_sasl_enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.password = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.proxies = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.redis_db = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.redis_sentinel_service_name = mymaster {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.redis_server = localhost:6379 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.retry_attempts = 2 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.retry_delay = 0.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.socket_keepalive_count = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.socket_keepalive_idle = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.socket_keepalive_interval = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.socket_timeout = 1.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.tls_allowed_ciphers = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.tls_cafile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.tls_certfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.tls_enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.tls_keyfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cache.username = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] coordination.backend_url = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.asyncio_connection = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.asyncio_slave_connection = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.backend = sqlalchemy {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.connection = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.connection_debug = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.connection_parameters = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.connection_recycle_time = 3600 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.connection_trace = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.db_inc_retry_interval = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.db_max_retries = 20 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.db_max_retry_interval = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.db_retry_interval = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.max_overflow = 50 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.max_pool_size = 5 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.max_retries = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.mysql_wsrep_sync_wait = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.pool_timeout = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.retry_interval = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.slave_connection = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.sqlite_synchronous = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.synchronous_reader = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] database.use_db_reconnect = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.connection_string = messaging:// {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.es_doc_type = notification {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.es_scroll_size = 10000 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.es_scroll_time = 2m {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.filter_error_trace = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.hmac_keys = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.sentinel_service_name = mymaster {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.socket_timeout = 0.1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.trace_requests = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler.trace_sqlalchemy = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler_jaeger.process_tags = {} {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler_jaeger.service_name_prefix = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] profiler_otlp.service_name_prefix = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.enforce_new_defaults = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: WARNING oslo_config.cfg [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.enforce_scope = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.policy_default_rule = default {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.policy_file = policy.yaml {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_policy.remote_timeout = 60.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] privsep_osbrick.group = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] privsep_osbrick.helper_command = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] privsep_osbrick.user = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_sys_admin.group = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_sys_admin.helper_command = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] cinder_sys_admin.user = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.auth_section = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.auth_type = password {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.cafile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.certfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.collect_timing = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.insecure = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.keyfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.send_service_user_token = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.split_loggers = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] service_user.timeout = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.auth_section = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.auth_type = password {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.certfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.collect_timing = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.insecure = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.keyfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.region_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.split_loggers = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] glance.timeout = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.backend_availability_zone = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.chap_password = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.chap_username = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.disk_geometry = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.driver_client_cert = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.driver_client_cert_key = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.driver_data_namespace = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.driver_use_ssl = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.enable_unsupported_driver = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.extra_capabilities = {} {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.filter_function = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.goodness_function = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.iscsi_target_flags = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.iscsi_write_cache = on {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.iser_helper = tgtadm {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.iser_port = 3260 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_host = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_login = admin {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_mount_options = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_password = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_private_key = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_share_path = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_ssh_port = 22 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.num_shell_tries = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.nvmet_port_id = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack quobyte-client[81737]: Reading configuration file: /etc/quobyte/client.cfg Apr 09 16:50:16 devstack quobyte-client[81737]: Invalid parameters found, error: missing mount point. Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.quobyte_client_cfg = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack quobyte-client[81737]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 09 16:50:16 devstack quobyte-client[81737]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.quobyte_volume_url = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.replication_device = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.report_discard_supported = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.reserved_percentage = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.scst_target_driver = iscsi {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.scst_target_iqn_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.storage_protocol = iSCSI {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.target_helper = tgtadm {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.target_port = 3260 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.target_protocol = iscsi {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.trace_flags = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.unique_fqdn_network = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.use_chap_auth = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volume_backend_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volume_clear = zero {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volume_clear_ionice = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volume_clear_size = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_reports.file_event_handler = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_reports.log_dir = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.backend_availability_zone = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.backend_host = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.chap_password = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.chap_username = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.chiscsi_conf = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.disk_geometry = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.driver_client_cert = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=81736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.driver_client_cert_key = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.driver_data_namespace = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: INFO cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 ... Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.driver_use_ssl = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 -c /etc/quobyte/client-cinder.cfg {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.extra_capabilities = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.filter_function = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.goodness_function = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.iscsi_target_flags = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.iscsi_write_cache = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.iser_helper = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.iser_ip_address = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.iser_port = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.iser_target_prefix = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_host = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_login = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_mount_options = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_password = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_private_key = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_share_path = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_ssh_port = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.num_shell_tries = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nvmet_ns_id = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.nvmet_port_id = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.replication_device = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.report_discard_supported = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.reserved_percentage = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.scst_target_driver = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.storage_protocol = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.target_helper = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack sudo[81738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 -c /etc/quobyte/client-cinder.cfg Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.target_ip_address = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.target_port = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack sudo[81738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.target_prefix = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.target_protocol = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.trace_flags = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.unique_fqdn_network = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.use_chap_auth = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volume_clear = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volume_clear_ionice = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volume_clear_size = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] QuobyteHD.volumes_dir = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.ssl = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.ssl_version = {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_notifications.driver = [] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_notifications.retry = -1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] oslo_messaging_notifications.transport_url = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] key_manager.fixed_key = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.barbican_api_version = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.barbican_endpoint = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.barbican_endpoint_type = public {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.barbican_region_name = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.cafile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.certfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.collect_timing = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.insecure = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.keyfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.number_of_retries = 60 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.retry_delay = 1 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.send_service_user_token = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.split_loggers = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.timeout = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.verify_ssl = True {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican.verify_ssl_path = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.auth_section = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.auth_type = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.cafile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.certfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.collect_timing = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.insecure = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.keyfile = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.split_loggers = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] barbican_service_user.timeout = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.approle_role_id = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.approle_secret_id = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.kv_mountpoint = secret {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.kv_path = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.kv_version = 2 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.namespace = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.root_token_id = **** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.ssl_ca_crt_file = None {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.timeout = 60.0 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.use_ssl = False {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:16 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] ******************************************************************************** {{(pid=81618) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 16:50:17 devstack sudo[81738]: pam_unix(sudo:session): session closed for user root Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.481s {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:17 devstack cinder-volume[81736]: INFO cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 succeeded Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=81736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.505s {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:17 devstack sudo[81807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:50:17 devstack sudo[81807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:50:17 devstack sudo[81807]: pam_unix(sudo:session): session closed for user root Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.375s {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:17 devstack cinder-volume[81736]: INFO cinder.volume.driver [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Driver hasn't implemented _init_vendor_properties() Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG cinder.volume.driver [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81736) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_db.sqlalchemy.engines [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG dbcounter [-] [81736] Writer thread running {{(pid=81736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG cinder.db.sqlalchemy.api [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Building query based on filter {{(pid=81736) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG cinder.image.image_utils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81736) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 16:50:17 devstack cinder-volume[81736]: INFO cinder.keymgr.migration [None req-b5010794-b47d-42e8-9573-4b990d1551fe None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=81736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=81736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:50:17 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:17 devstack sudo[81810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:50:17 devstack sudo[81810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:50:18 devstack sudo[81810]: pam_unix(sudo:session): session closed for user root Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.396s {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG cinder.manager [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Notifying Schedulers of capabilities ... {{(pid=81736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:50:18 devstack cinder-volume[81736]: INFO cinder.volume.manager [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Driver initialization completed successfully. Apr 09 16:50:18 devstack cinder-volume[81736]: INFO cinder.manager [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Initiating service 3 cleanup Apr 09 16:50:18 devstack cinder-volume[81736]: INFO cinder.manager [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Service 3 cleanup completed. Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG cinder.service [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Creating RPC server for service cinder-volume {{(pid=81736) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG cinder.service [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81736) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 16:50:18 devstack cinder-volume[81736]: INFO cinder.volume.manager [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=81736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=81736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:18 devstack sudo[81815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:50:18 devstack sudo[81815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:50:18 devstack sudo[81815]: pam_unix(sudo:session): session closed for user root Apr 09 16:50:18 devstack cinder-volume[81736]: DEBUG oslo_concurrency.processutils [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.400s {{(pid=81736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:18 devstack cinder-volume[81736]: INFO cinder.volume.manager [None req-f5dd2c84-792c-4f95-839e-286c2ee6afa9 None None] Driver post RPC initialization completed successfully. Apr 09 16:50:20 devstack cinder-volume[81618]: INFO oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Caught SIGTERM, stopping children Apr 09 16:50:20 devstack cinder-volume[81618]: DEBUG oslo_concurrency.lockutils [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Acquiring lock "singleton_lock" {{(pid=81618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 16:50:20 devstack cinder-volume[81618]: DEBUG oslo_concurrency.lockutils [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Acquired lock "singleton_lock" {{(pid=81618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 16:50:20 devstack cinder-volume[81618]: DEBUG oslo_concurrency.lockutils [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Releasing lock "singleton_lock" {{(pid=81618) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 16:50:20 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Stop services. {{(pid=81618) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 09 16:50:20 devstack cinder-volume[81618]: DEBUG oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Killing children. {{(pid=81618) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 09 16:50:20 devstack cinder-volume[81618]: INFO oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Waiting on 1 children to exit Apr 09 16:50:22 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Acquiring lock "singleton_lock" {{(pid=81736) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 16:50:22 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Acquired lock "singleton_lock" {{(pid=81736) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 16:50:22 devstack cinder-volume[81736]: DEBUG oslo_concurrency.lockutils [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Releasing lock "singleton_lock" {{(pid=81736) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 16:50:22 devstack cinder-volume[81736]: WARNING amqp [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 16:50:22 devstack cinder-volume[81736]: WARNING amqp [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 16:50:22 devstack cinder-volume[81618]: INFO oslo_service.backend._eventlet.service [None req-0ba34ec6-3ea4-442a-a788-4045726165ca None None] Child 81736 exited with status 0 Apr 09 16:50:22 devstack cinder-volume[81955]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 16:50:22 devstack cinder-volume[81955]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 16:50:22 devstack cinder-volume[81955]: we strongly recommend against using it for new projects. Apr 09 16:50:22 devstack cinder-volume[81955]: If you are already using Eventlet, we recommend migrating to a different Apr 09 16:50:22 devstack cinder-volume[81955]: framework. For more detail see Apr 09 16:50:22 devstack cinder-volume[81955]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 16:50:22 devstack cinder-volume[81955]: import eventlet # noqa Apr 09 16:50:24 devstack cinder-volume[81955]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 16:50:24 devstack cinder-volume[81955]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 16:50:24 devstack cinder-volume[81955]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 16:50:24 devstack cinder-volume[81955]: INFO dbcounter [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Registered counter for database cinder Apr 09 16:50:24 devstack cinder-volume[81955]: DEBUG oslo_db.sqlalchemy.engines [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG dbcounter [-] [81955] Writer thread running {{(pid=81955) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 16:50:25 devstack cinder-volume[81955]: INFO cinder.rpc [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 16:50:25 devstack cinder-volume[81955]: INFO cinder.rpc [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_db.sqlalchemy.engines [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:50:25 devstack cinder-volume[81955]: INFO cinder.volume.manager [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Determined volume DB was empty at startup. Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG cinder.volume.manager [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81955) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 16:50:25 devstack cinder-volume[81955]: WARNING stevedore.named [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 16:50:25 devstack cinder-volume[81955]: WARNING castellan.key_manager [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 16:50:25 devstack cinder-volume[81955]: WARNING cinder.keymgr.conf_key_mgr [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 16:50:25 devstack cinder-volume[81955]: INFO cinder.volume.manager [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_db.sqlalchemy.engines [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:50:25 devstack cinder-volume[81955]: INFO oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Starting 1 workers Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Started child 82139 {{(pid=81955) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Full set of CONF: {{(pid=81955) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] ******************************************************************************** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Configuration options gathered from: {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] ================================================================================ {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] allow_availability_zone_fallback = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] allow_compression_on_image_upload = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] allowed_direct_url_schemes = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] api_rate_limit = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] auth_strategy = keystone {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_availability_zone = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_host = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_stats_polling_interval = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backup_api_class = cinder.backup.api.API {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backup_name_template = backup-%s {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backup_use_same_host = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backup_use_temp_snapshot = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] chap_password = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] chap_username = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_internal_tenant_project_id = cdae92d9ad234a9bb88336b9e4f55ad8 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_internal_tenant_user_id = d9cef06baf1d4f2eac67229a20698f7f {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cluster = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] compression_format = gzip {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] compute_api_class = cinder.compute.nova.API {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] config_dir = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] config_source = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] control_exchange = openstack {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] debug = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] default_availability_zone = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] default_group_type = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] default_volume_type = QuobyteHD {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] disk_geometry = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] driver_client_cert = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] driver_client_cert_key = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] driver_data_namespace = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] driver_ssl_cert_path = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] driver_ssl_cert_verify = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] driver_use_ssl = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] enable_new_services = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] enable_unsupported_driver = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] enabled_backends = ['QuobyteHD'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] enforce_multipath_for_image_xfer = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] filter_function = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_api_insecure = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[82139]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_api_servers = ['http://192.168.122.252/image'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_api_ssl_compression = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_ca_certificates_file = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_catalog_info = image:glance:publicURL {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_certfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_keyfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_num_retries = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance_request_timeout = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] goodness_function = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] graceful_shutdown_timeout = 5 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] group_api_class = cinder.group.api.API {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] host = devstack {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_compress_on_upload = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_conversion_address_space_limit = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_conversion_cpu_limit = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_conversion_disable = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_upload_use_cinder_backend = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_upload_use_internal_tenant = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_volume_cache_enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_volume_cache_max_count = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] init_host_max_objects_retrieval = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] instance_format = [instance: %(uuid)s] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] iscsi_target_flags = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] iscsi_write_cache = on {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] iser_helper = tgtadm {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] iser_ip_address = 192.168.122.252 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] iser_port = 3260 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_color = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_config_append = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_dir = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_file = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_options = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_rotate_interval = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_rotate_interval_type = days {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] log_rotation_type = none {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] max_age = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] max_logfile_count = 30 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] max_logfile_size_mb = 200 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] max_over_subscription_ratio = 20.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] message_reap_interval = 86400 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] message_ttl = 2592000 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] monkey_patch = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] monkey_patch_modules = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] my_ip = 192.168.122.252 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] no_snapshot_gb_quota = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] num_iser_scan_tries = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] num_shell_tries = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] num_volume_device_scan_tries = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] nvmeof_conn_info_version = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] nvmet_ns_id = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] nvmet_port_id = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] osapi_max_limit = 1000 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] osapi_volume_ext_list = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] osapi_volume_listen_port = 8776 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] osapi_volume_use_ssl = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] osapi_volume_workers = 2 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] per_volume_size_limit = -1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] periodic_fuzzy_delay = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] periodic_interval = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] public_endpoint = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] publish_errors = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] quota_backup_gigabytes = 1000 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] quota_backups = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] quota_gigabytes = 1000 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] quota_groups = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] quota_snapshots = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] quota_volumes = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] rate_limit_burst = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] rate_limit_except_level = CRITICAL {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] rate_limit_interval = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] reinit_driver_count = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] replication_device = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] report_discard_supported = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] report_interval = 120 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] reservation_clean_interval = 86400 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] reservation_expire = 86400 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] reserved_image_namespaces = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] reserved_percentage = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] rpc_response_timeout = 120 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] run_external_periodic_tasks = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] scst_target_driver = iscsi {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] scst_target_iqn_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_down_time = 720 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] shell_completion = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] snapshot_name_template = snapshot-%s {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] split_loggers = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] state_path = /opt/stack/data/cinder {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] storage_availability_zone = nova {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] storage_protocol = iSCSI {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] syslog_log_facility = LOG_USER {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] target_helper = lioadm {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] target_ip_address = 192.168.122.252 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] target_port = 3260 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] target_protocol = iscsi {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] target_secondary_ip_addresses = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] trace_flags = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] transport_url = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] until_refresh = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] use_chap_auth = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] use_default_quota_class = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] use_journal = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] use_json = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] use_multipath_for_image_xfer = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] use_stderr = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] use_syslog = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] verify_glance_signatures = enabled {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_api_class = cinder.volume.api.API {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_backend_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_clear = zero {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_clear_ionice = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_clear_size = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_copy_bps_limit = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_dd_blocksize = 1M {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_name_template = volume-%s {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_service_inithost_offload = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volume_usage_audit_period = month {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] zoning_mode = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.admin_password = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.admin_token = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.admin_user = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.auth_port = 35357 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.auth_protocol = https {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.auth_section = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.auth_type = password {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.auth_uri = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.auth_version = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.cache = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.certfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.identity_uri = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.insecure = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.interface = public {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.keyfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_password = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcache_username = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.region_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.service_type = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.backend = dogpile.cache.null {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.backend_argument = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.backend_expiration_time = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.config_prefix = cache.oslo {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.debug_cache_backend = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.enable_retry_client = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.enable_socket_keepalive = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.enforce_fips_mode = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.expiration_time = 600 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.memcache_dead_retry = 300 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.memcache_pool_maxsize = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.memcache_sasl_enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.password = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.proxies = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.redis_db = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.redis_server = localhost:6379 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.retry_attempts = 2 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.retry_delay = 0.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.socket_keepalive_count = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.socket_keepalive_idle = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.socket_keepalive_interval = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.socket_timeout = 1.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.tls_allowed_ciphers = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.tls_cafile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.tls_certfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.tls_enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.tls_keyfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cache.username = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] coordination.backend_url = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.asyncio_connection = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.asyncio_slave_connection = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.backend = sqlalchemy {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.connection = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.connection_debug = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.connection_parameters = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.connection_recycle_time = 3600 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.connection_trace = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.db_inc_retry_interval = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.db_max_retries = 20 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.db_max_retry_interval = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.db_retry_interval = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.max_overflow = 50 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.max_pool_size = 5 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.max_retries = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.pool_timeout = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.retry_interval = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.slave_connection = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.sqlite_synchronous = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.synchronous_reader = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] database.use_db_reconnect = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.connection_string = messaging:// {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.es_doc_type = notification {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.es_scroll_size = 10000 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.es_scroll_time = 2m {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.filter_error_trace = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.hmac_keys = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.sentinel_service_name = mymaster {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.socket_timeout = 0.1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.trace_requests = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler.trace_sqlalchemy = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler_jaeger.process_tags = {} {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] profiler_otlp.service_name_prefix = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.enforce_new_defaults = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: WARNING oslo_config.cfg [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.enforce_scope = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.policy_default_rule = default {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.policy_file = policy.yaml {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] privsep_osbrick.group = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] privsep_osbrick.helper_command = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] privsep_osbrick.user = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_sys_admin.group = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_sys_admin.helper_command = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] cinder_sys_admin.user = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.auth_section = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.auth_type = password {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.cafile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.certfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.collect_timing = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.insecure = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.keyfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.send_service_user_token = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.split_loggers = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] service_user.timeout = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.auth_section = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.auth_type = password {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.certfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82139) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.collect_timing = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.insecure = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.keyfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.region_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.split_loggers = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] glance.timeout = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.backend_availability_zone = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.chap_password = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.chap_username = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.disk_geometry = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.driver_client_cert = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.driver_data_namespace = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.driver_use_ssl = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.extra_capabilities = {} {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.filter_function = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.goodness_function = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.iscsi_target_flags = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.iser_helper = tgtadm {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.iser_port = 3260 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_host = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_login = admin {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_mount_options = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_password = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_private_key = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_share_path = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.quobyte_volume_url = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.replication_device = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.report_discard_supported = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.target_helper = tgtadm {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.target_port = 3260 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.target_protocol = iscsi {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.trace_flags = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.use_chap_auth = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volume_backend_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volume_clear = zero {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_reports.file_event_handler = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_reports.log_dir = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.backend_availability_zone = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.backend_host = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.chap_password = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.chap_username = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.chiscsi_conf = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.disk_geometry = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.driver_client_cert = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.driver_data_namespace = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack quobyte-client[82167]: Reading configuration file: /etc/quobyte/client.cfg Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.driver_use_ssl = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.extra_capabilities = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.filter_function = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.goodness_function = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack quobyte-client[82167]: Invalid parameters found, error: missing mount point. Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.iser_helper = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack quobyte-client[82167]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.iser_ip_address = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.iser_port = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.iser_target_prefix = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_host = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_login = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_mount_options = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack quobyte-client[82167]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_password = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_private_key = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_share_path = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_ssh_port = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.num_shell_tries = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.nvmet_port_id = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.replication_device = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.report_discard_supported = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.reserved_percentage = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.scst_target_driver = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.storage_protocol = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.target_helper = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.target_ip_address = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.target_port = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.target_prefix = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.target_protocol = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.trace_flags = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.use_chap_auth = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82139) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 09 16:50:25 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 09 16:50:25 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volume_clear = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volume_clear_size = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] QuobyteHD.volumes_dir = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Running cmd (subprocess): mount.quobyte {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack sudo[82170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.ssl = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack sudo[82170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_notifications.driver = [] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] key_manager.fixed_key = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.barbican_api_version = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.barbican_endpoint = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.barbican_endpoint_type = public {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.barbican_region_name = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.cafile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.certfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.collect_timing = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.insecure = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.keyfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.number_of_retries = 60 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.retry_delay = 1 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.send_service_user_token = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.split_loggers = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.timeout = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.verify_ssl = True {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican.verify_ssl_path = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.auth_section = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.auth_type = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.cafile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.certfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.collect_timing = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.insecure = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.keyfile = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.split_loggers = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] barbican_service_user.timeout = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.approle_role_id = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.approle_secret_id = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.kv_mountpoint = secret {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.kv_path = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.kv_version = 2 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.namespace = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.root_token_id = **** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.ssl_ca_crt_file = None {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.timeout = 60.0 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.use_ssl = False {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 16:50:25 devstack cinder-volume[81955]: DEBUG oslo_service.backend._eventlet.service [None req-aa35c6f6-7e09-499c-abe8-7bd25e8032a7 None None] ******************************************************************************** {{(pid=81955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:50:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:26 devstack sudo[82170]: pam_unix(sudo:session): session closed for user root Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.456s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:26 devstack cinder-volume[82139]: INFO cinder.volume.driver [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Driver hasn't implemented _init_vendor_properties() Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.volume.driver [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82139) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writer thread running {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.db.sqlalchemy.api [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Building query based on filter {{(pid=82139) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82139) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:26 devstack cinder-volume[82139]: INFO cinder.keymgr.migration [None req-8c874ad9-2ea9-4b0b-9660-bb15cd338d44 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 16:50:26 devstack sudo[82197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:50:26 devstack sudo[82197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:50:26 devstack sudo[82197]: pam_unix(sudo:session): session closed for user root Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.404s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:50:26 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Driver initialization completed successfully. Apr 09 16:50:26 devstack cinder-volume[82139]: INFO cinder.manager [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Initiating service 3 cleanup Apr 09 16:50:26 devstack cinder-volume[82139]: INFO cinder.manager [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Service 3 cleanup completed. Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.service [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Creating RPC server for service cinder-volume {{(pid=82139) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.service [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82139) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 16:50:26 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:50:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:50:26 devstack sudo[82202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:50:26 devstack sudo[82202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:50:27 devstack sudo[82202]: pam_unix(sudo:session): session closed for user root Apr 09 16:50:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.434s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:50:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3c9a5cf2-c177-486a-9c7d-2361d5392d50 None None] Driver post RPC initialization completed successfully. Apr 09 16:50:35 devstack cinder-volume[81955]: DEBUG dbcounter [-] [81955] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81955) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:50:36 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:50:37 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=2 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Flow 'volume_create_manager' (4882bbc7-d311-4a04-b489-1bd1d8ffd709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8aa9d45-f3e3-453b-a460-0fdc7812677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8aa9d45-f3e3-453b-a460-0fdc7812677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-656185015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2e9961-989b-47a0-b507-d943b6599dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85eb01c316da4e84a1ba159a0da9d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:25Z,use_quota=True,user_id='ae6b91b53baf490fb03dc2fc1541db3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719b0fc4-b65a-4225-9092-a81722a36b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719b0fc4-b65a-4225-9092-a81722a36b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cae147-f397-48bf-9166-ae8ccae19d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cae147-f397-48bf-9166-ae8ccae19d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2e9961-989b-47a0-b507-d943b6599dec', 'volume_name': 'volume-6a2e9961-989b-47a0-b507-d943b6599dec', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d51b7d-924a-49e0-9bc9-974255652911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d51b7d-924a-49e0-9bc9-974255652911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe3d0ed-7212-414d-a69f-6bc32275fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Volume 6a2e9961-989b-47a0-b507-d943b6599dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2e9961-989b-47a0-b507-d943b6599dec', 'volume_size': 1} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-656185015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2e9961-989b-47a0-b507-d943b6599dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85eb01c316da4e84a1ba159a0da9d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:25Z,use_quota=True,user_id='ae6b91b53baf490fb03dc2fc1541db3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Creating volume 6a2e9961-989b-47a0-b507-d943b6599dec {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:51:25 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:25 devstack sudo[82612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec 1073741824 Apr 09 16:51:25 devstack sudo[82612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Flow 'volume_create_manager' (d89e9836-8a60-4947-a659-dd71b3c463b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0aa210f-da24-47e8-a62e-6f544c1bb54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0aa210f-da24-47e8-a62e-6f544c1bb54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-676987693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd55c800-972f-4047-8b55-90610c7e98c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ec0d614afd74aa1ad4724f1eff60e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:26Z,use_quota=True,user_id='33ae773de6454943a467e5d75cde4040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db31886-adef-4303-87de-a4b6a7ad47d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db31886-adef-4303-87de-a4b6a7ad47d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84859a90-425b-4c0f-992c-4f1c736635d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84859a90-425b-4c0f-992c-4f1c736635d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd55c800-972f-4047-8b55-90610c7e98c2', 'volume_name': 'volume-cd55c800-972f-4047-8b55-90610c7e98c2', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bebf5e-ec78-49ca-9b68-a40e41d45878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bebf5e-ec78-49ca-9b68-a40e41d45878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49546b9f-208d-4aba-b71f-6b3225b24439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Volume cd55c800-972f-4047-8b55-90610c7e98c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd55c800-972f-4047-8b55-90610c7e98c2', 'volume_size': 1} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Flow 'volume_create_manager' (a53968ad-33ca-45a1-b8e2-386deecef343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a599ec5b-a725-4175-b281-ac1f4455d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a599ec5b-a725-4175-b281-ac1f4455d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2005583738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3122ee0-e02d-4ecc-a40d-82aacc15ab2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f38bf230d94315940e60d216bd4a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:26Z,use_quota=True,user_id='1a420e5492644b2699ee6a2400fa7fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d383442-7459-4e23-8167-28d5f2ac2e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d383442-7459-4e23-8167-28d5f2ac2e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800afc06-5300-4d41-8405-0cbf35d6d19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800afc06-5300-4d41-8405-0cbf35d6d19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3122ee0-e02d-4ecc-a40d-82aacc15ab2a', 'volume_name': 'volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfb5771-afad-49fd-8b34-bed1c8bab0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfb5771-afad-49fd-8b34-bed1c8bab0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e98d869-777c-421d-ac50-18025c2f5650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Volume d3122ee0-e02d-4ecc-a40d-82aacc15ab2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a', 'volume_size': 1} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:25 devstack sudo[82612]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec 1073741824" returned: 0 in 0.645s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:25 devstack sudo[82938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec Apr 09 16:51:25 devstack sudo[82938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:26 devstack sudo[82938]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec" returned: 0 in 0.476s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-676987693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd55c800-972f-4047-8b55-90610c7e98c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ec0d614afd74aa1ad4724f1eff60e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:26Z,use_quota=True,user_id='33ae773de6454943a467e5d75cde4040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Creating volume cd55c800-972f-4047-8b55-90610c7e98c2 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:51:26 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe3d0ed-7212-414d-a69f-6bc32275fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2e9961-989b-47a0-b507-d943b6599dec', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:26 devstack sudo[82945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 1073741824 Apr 09 16:51:26 devstack sudo[82945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bcebe8-32bc-4c57-b784-12a9817966f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:26 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Volume volume-6a2e9961-989b-47a0-b507-d943b6599dec (6a2e9961-989b-47a0-b507-d943b6599dec): created successfully Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bcebe8-32bc-4c57-b784-12a9817966f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Flow 'volume_create_manager' (4882bbc7-d311-4a04-b489-1bd1d8ffd709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:26 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c698e184-18a3-4fa8-b228-c02de16ecb62 tempest-VolumesAdminNegativeTest-756754559 None] Created volume successfully. Apr 09 16:51:26 devstack sudo[82945]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 1073741824" returned: 0 in 0.464s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:26 devstack sudo[82950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 Apr 09 16:51:26 devstack sudo[82950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:27 devstack sudo[82950]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2" returned: 0 in 0.553s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2005583738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3122ee0-e02d-4ecc-a40d-82aacc15ab2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f38bf230d94315940e60d216bd4a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:26Z,use_quota=True,user_id='1a420e5492644b2699ee6a2400fa7fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Creating volume d3122ee0-e02d-4ecc-a40d-82aacc15ab2a {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:51:27 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49546b9f-208d-4aba-b71f-6b3225b24439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd55c800-972f-4047-8b55-90610c7e98c2', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50f33b9-a444-421f-a5ba-0208af5bf41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:27 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Volume volume-cd55c800-972f-4047-8b55-90610c7e98c2 (cd55c800-972f-4047-8b55-90610c7e98c2): created successfully Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50f33b9-a444-421f-a5ba-0208af5bf41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Flow 'volume_create_manager' (d89e9836-8a60-4947-a659-dd71b3c463b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:27 devstack sudo[82954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a 1073741824 Apr 09 16:51:27 devstack sudo[82954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c8f8f56e-f2ab-41e6-afb9-a8edee9d115c tempest-VolumesTestJSON-104394026 None] Created volume successfully. Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Acquiring lock "cinder-6a2e9961-989b-47a0-b507-d943b6599dec-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Lock "cinder-6a2e9961-989b-47a0-b507-d943b6599dec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Acquiring lock "cinder-quobyte-6a2e9961-989b-47a0-b507-d943b6599dec" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Lock "cinder-quobyte-6a2e9961-989b-47a0-b507-d943b6599dec" acquired by "delete_volume" :: waited 0.043s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:27 devstack cinder-volume[82139]: INFO oslo.privsep.daemon [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8gv5ezk9/privsep.sock'] Apr 09 16:51:27 devstack sudo[82958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8gv5ezk9/privsep.sock Apr 09 16:51:27 devstack sudo[82958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:28 devstack sudo[82954]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a 1073741824" returned: 0 in 0.607s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:28 devstack sudo[82964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a Apr 09 16:51:28 devstack sudo[82964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 09 16:51:28 devstack sudo[82964]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a" returned: 0 in 0.545s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e98d869-777c-421d-ac50-18025c2f5650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bb2c0c-a541-4bba-a0c4-8e31c87e9689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:28 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Volume volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a (d3122ee0-e02d-4ecc-a40d-82aacc15ab2a): created successfully Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bb2c0c-a541-4bba-a0c4-8e31c87e9689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Flow 'volume_create_manager' (a53968ad-33ca-45a1-b8e2-386deecef343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f2c76e3a-57b4-4dd9-a681-3b275a761370 tempest-DeleteServersTestJSON-1294003244 None] Created volume successfully. Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 16:51:28 devstack cinder-volume[82139]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Flow 'volume_create_manager' (17d9834d-6c37-4c9a-9ce7-4083a40221d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fb8d68-4acd-4278-b476-526ac37afe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fb8d68-4acd-4278-b476-526ac37afe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-656552012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3df344f-3495-473b-adf8-3f884ee7b7b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ec0d614afd74aa1ad4724f1eff60e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:29Z,use_quota=True,user_id='33ae773de6454943a467e5d75cde4040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf32248-25fa-4b57-8c6f-137f3ac5059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf32248-25fa-4b57-8c6f-137f3ac5059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b529d4-1088-4ef8-862b-6c1eb0ac8e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b529d4-1088-4ef8-862b-6c1eb0ac8e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3df344f-3495-473b-adf8-3f884ee7b7b7', 'volume_name': 'volume-f3df344f-3495-473b-adf8-3f884ee7b7b7', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1975443-75d1-4e00-bdbf-329261ae1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1975443-75d1-4e00-bdbf-329261ae1f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e926a5-5b38-462e-8d8c-33ec73d73171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:29 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Volume f3df344f-3495-473b-adf8-3f884ee7b7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3df344f-3495-473b-adf8-3f884ee7b7b7', 'volume_size': 1} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-656552012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3df344f-3495-473b-adf8-3f884ee7b7b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ec0d614afd74aa1ad4724f1eff60e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:29Z,use_quota=True,user_id='33ae773de6454943a467e5d75cde4040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Creating volume f3df344f-3495-473b-adf8-3f884ee7b7b7 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:51:29 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:29 devstack sudo[82971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 1073741824 Apr 09 16:51:29 devstack sudo[82971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:29 devstack sudo[82958]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:29 devstack cinder-volume[82139]: INFO oslo.privsep.daemon [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Spawned new privsep daemon via rootwrap Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Accepted privsep connection to /tmp/tmp8gv5ezk9/privsep.sock {{(pid=82139) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 09 16:51:29 devstack cinder-volume[82139]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 09 16:51:29 devstack cinder-volume[82139]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 09 16:51:29 devstack cinder-volume[82139]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 09 16:51:29 devstack cinder-volume[82139]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82970 Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775ea1b-64c1-490e-8f5c-d6ec1e40bc35]: (2,) {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f4d405-d424-43fc-bfb0-67741e3efda8]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:29 devstack sudo[82975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec Apr 09 16:51:29 devstack sudo[82975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:29 devstack sudo[82971]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 1073741824" returned: 0 in 0.653s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:29 devstack sudo[82983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 Apr 09 16:51:29 devstack sudo[82983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:30 devstack sudo[82975]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec" returned: 0 in 0.877s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:30 devstack sudo[82991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec Apr 09 16:51:30 devstack sudo[82991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:30 devstack sudo[82983]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7" returned: 0 in 0.939s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:30 devstack sudo[82991]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6a2e9961-989b-47a0-b507-d943b6599dec" returned: 0 in 0.492s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e926a5-5b38-462e-8d8c-33ec73d73171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3df344f-3495-473b-adf8-3f884ee7b7b7', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620725eb-37bc-4006-b5ea-69bbb4d38feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:30 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Volume volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 (f3df344f-3495-473b-adf8-3f884ee7b7b7): created successfully Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620725eb-37bc-4006-b5ea-69bbb4d38feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Flow 'volume_create_manager' (17d9834d-6c37-4c9a-9ce7-4083a40221d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Lock "cinder-quobyte-6a2e9961-989b-47a0-b507-d943b6599dec" released by "delete_volume" :: held 2.969s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-92350e0d-6263-4de3-a5d4-0bbeec0a4e6d tempest-VolumesTestJSON-104394026 None] Created volume successfully. Apr 09 16:51:30 devstack cinder-volume[82139]: WARNING cinder.quota [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:51:30 devstack cinder-volume[82139]: WARNING cinder.quota [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Created reservations ['429b53b9-45fc-45d9-b78e-96c6624fbbd2', '886e7895-a068-4688-916b-277ac7982350', '7595aea7-8ad8-411f-a347-15f3d92c7f29', '5be578af-9ef1-46fb-a10b-6b6d61077b3c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:30 devstack sudo[83003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:51:30 devstack sudo[83003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:31 devstack sudo[83003]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.656s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:31 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:51:31 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Deleted volume successfully. Apr 09 16:51:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-32c4a7e4-b730-4818-82f4-17688e0b7b7c tempest-VolumesAdminNegativeTest-756754559 None] Lock "cinder-6a2e9961-989b-47a0-b507-d943b6599dec-delete_volume" released by "delete_volume" :: held 3.921s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:31 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Flow 'volume_create_manager' (959d58fc-e8a4-4e83-abb5-7b1252a1e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ff95d4-0436-4d3e-9856-cc17d5a237ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ff95d4-0436-4d3e-9856-cc17d5a237ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-239350362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ec0d614afd74aa1ad4724f1eff60e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:32Z,use_quota=True,user_id='33ae773de6454943a467e5d75cde4040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e35752c-ffa8-4583-80bb-08063c9a7e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e35752c-ffa8-4583-80bb-08063c9a7e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d09c542-afa1-4640-ab13-83f53d1891c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d09c542-afa1-4640-ab13-83f53d1891c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b', 'volume_name': 'volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4401824-1776-4e82-a8d5-3d0c48518901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4401824-1776-4e82-a8d5-3d0c48518901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc73eb7f-7208-4eca-9b4d-7348cd5dbbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:32 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Volume bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b', 'volume_size': 1} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-239350362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ec0d614afd74aa1ad4724f1eff60e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:32Z,use_quota=True,user_id='33ae773de6454943a467e5d75cde4040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Creating volume bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:51:32 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:51:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:32 devstack sudo[83008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b 1073741824 Apr 09 16:51:32 devstack sudo[83008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:33 devstack sudo[83008]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b 1073741824" returned: 0 in 1.192s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:33 devstack sudo[83082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b Apr 09 16:51:33 devstack sudo[83082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:34 devstack sudo[83082]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b" returned: 0 in 0.712s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:51:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc73eb7f-7208-4eca-9b4d-7348cd5dbbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268e3feb-82bc-4493-926d-75dedb20b4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:34 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Volume volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b (bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b): created successfully Apr 09 16:51:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268e3feb-82bc-4493-926d-75dedb20b4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Flow 'volume_create_manager' (959d58fc-e8a4-4e83-abb5-7b1252a1e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:34 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-9800a21e-5b9e-42f7-bba2-9d2773c7fc10 tempest-VolumesTestJSON-104394026 None] Created volume successfully. Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Acquiring lock "cinder-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Lock "cinder-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Acquiring lock "cinder-quobyte-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Lock "cinder-quobyte-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b63351c-9fa4-4679-b575-e7e43c11044b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:35 devstack sudo[83110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b Apr 09 16:51:35 devstack sudo[83110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:35 devstack cinder-volume[82139]: WARNING py.warnings [req-03695963-2acd-43d5-8c08-c86bd79127b5 req-ba8c5f76-bcec-456f-b6e6-eda0c75363a2 tempest-DeleteServersTestJSON-1294003244 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 09 16:51:35 devstack cinder-volume[82139]: .first() Apr 09 16:51:35 devstack cinder-volume[82139]: Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-03695963-2acd-43d5-8c08-c86bd79127b5 req-ba8c5f76-bcec-456f-b6e6-eda0c75363a2 tempest-DeleteServersTestJSON-1294003244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-03695963-2acd-43d5-8c08-c86bd79127b5 req-ba8c5f76-bcec-456f-b6e6-eda0c75363a2 tempest-DeleteServersTestJSON-1294003244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c416bf80-025f-44cf-a447-59fe8560112c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-03695963-2acd-43d5-8c08-c86bd79127b5 req-ba8c5f76-bcec-456f-b6e6-eda0c75363a2 tempest-DeleteServersTestJSON-1294003244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:35 devstack sudo[83113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a Apr 09 16:51:35 devstack sudo[83113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:35 devstack sudo[83110]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b" returned: 0 in 0.543s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:35 devstack sudo[83118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b Apr 09 16:51:35 devstack sudo[83118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:35 devstack sudo[83113]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-03695963-2acd-43d5-8c08-c86bd79127b5 req-ba8c5f76-bcec-456f-b6e6-eda0c75363a2 tempest-DeleteServersTestJSON-1294003244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a" returned: 0 in 0.595s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-03695963-2acd-43d5-8c08-c86bd79127b5 req-ba8c5f76-bcec-456f-b6e6-eda0c75363a2 tempest-DeleteServersTestJSON-1294003244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.612s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-03695963-2acd-43d5-8c08-c86bd79127b5 req-ba8c5f76-bcec-456f-b6e6-eda0c75363a2 tempest-DeleteServersTestJSON-1294003244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784', 'name': 'volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12bee7a3-ae0f-4d25-8173-b0a30d188e44', 'enforce_multipath': True} {{(pid=82139) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 16:51:35 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-03695963-2acd-43d5-8c08-c86bd79127b5 req-ba8c5f76-bcec-456f-b6e6-eda0c75363a2 tempest-DeleteServersTestJSON-1294003244 None] attachment_update completed successfully. Apr 09 16:51:36 devstack sudo[83118]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b" returned: 0 in 0.544s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Lock "cinder-quobyte-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b" released by "delete_volume" :: held 1.109s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Created reservations ['4f94ef64-100b-43c3-b6b9-6f58fb576506', '50280f4e-3ff9-47d5-b2f5-e86e0dcf4cae', '5f4e875e-344b-438a-ab53-cb2be03ec142', '728a4180-2373-4ff6-9668-3a710f6cefae'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:36 devstack sudo[83125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:51:36 devstack sudo[83125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:36 devstack sudo[83125]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:51:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Deleted volume successfully. Apr 09 16:51:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3af579ec-e6b8-4264-bb57-2033050bf2cc tempest-VolumesTestJSON-104394026 None] Lock "cinder-bcf4815c-f60c-4ba4-aee5-00ec7e2ace4b-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Acquiring lock "cinder-f3df344f-3495-473b-adf8-3f884ee7b7b7-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Lock "cinder-f3df344f-3495-473b-adf8-3f884ee7b7b7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Acquiring lock "cinder-quobyte-f3df344f-3495-473b-adf8-3f884ee7b7b7" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Lock "cinder-quobyte-f3df344f-3495-473b-adf8-3f884ee7b7b7" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:37 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b994cae-b5d5-4f85-a6f3-4d1121064fb0]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:37 devstack sudo[83514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 Apr 09 16:51:37 devstack sudo[83514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:37 devstack sudo[83514]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7" returned: 0 in 0.510s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:37 devstack sudo[83519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7 Apr 09 16:51:37 devstack sudo[83519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:38 devstack sudo[83519]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f3df344f-3495-473b-adf8-3f884ee7b7b7" returned: 0 in 0.452s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Lock "cinder-quobyte-f3df344f-3495-473b-adf8-3f884ee7b7b7" released by "delete_volume" :: held 0.987s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Created reservations ['84e468be-691a-493f-8681-a4bbfda55f43', '10a62da4-ebeb-45a9-91ce-cd0d1f9b3902', '1e82327a-c04d-404d-a455-285540f069dd', '60d559a0-7fe7-4eb0-acee-fa8d66092342'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:38 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:51:38 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:39 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.940s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:51:39 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Deleted volume successfully. Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-08318aff-1fae-4072-b42d-d5ec09b5d9f0 tempest-VolumesTestJSON-104394026 None] Lock "cinder-f3df344f-3495-473b-adf8-3f884ee7b7b7-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Acquiring lock "cinder-cd55c800-972f-4047-8b55-90610c7e98c2-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Lock "cinder-cd55c800-972f-4047-8b55-90610c7e98c2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Acquiring lock "cinder-quobyte-cd55c800-972f-4047-8b55-90610c7e98c2" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Lock "cinder-quobyte-cd55c800-972f-4047-8b55-90610c7e98c2" acquired by "delete_volume" :: waited 0.015s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0426351-5e2f-4ce5-b8a4-ec61e6729f57]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:39 devstack sudo[83562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 Apr 09 16:51:39 devstack sudo[83562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:40 devstack sudo[83562]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2" returned: 0 in 0.716s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:40 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2 Apr 09 16:51:40 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:40 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cd55c800-972f-4047-8b55-90610c7e98c2" returned: 0 in 0.576s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Lock "cinder-quobyte-cd55c800-972f-4047-8b55-90610c7e98c2" released by "delete_volume" :: held 1.356s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:40 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Created reservations ['15730b9f-5e67-4391-bd01-3a38da02b871', 'ec918a3d-1b9b-4376-8605-0a926a53fa2d', 'f61c2937-620b-4422-b0e8-e408465e17b3', '36b7cb1f-098f-4a22-ae1b-e5d09f585cf0'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:41 devstack sudo[83591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:51:41 devstack sudo[83591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:41 devstack sudo[83591]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.654s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:51:41 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Deleted volume successfully. Apr 09 16:51:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2592ce5f-e18f-4f9e-bbf9-6fb5b5245bed tempest-VolumesTestJSON-104394026 None] Lock "cinder-cd55c800-972f-4047-8b55-90610c7e98c2-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:45 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-2857055b-85c4-4873-80dc-f18585b7d7c1 req-425c0e72-9461-4d5e-b067-14cb53ac1909 tempest-DeleteServersTestJSON-1294003244 None] Terminate volume connection completed successfully. Apr 09 16:51:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2857055b-85c4-4873-80dc-f18585b7d7c1 req-425c0e72-9461-4d5e-b067-14cb53ac1909 tempest-DeleteServersTestJSON-1294003244 None] Deleting attachment 12bee7a3-ae0f-4d25-8173-b0a30d188e44. {{(pid=82139) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 16:51:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2c9c64c3-7317-4912-acd7-391f03cf7694 tempest-BackendsCapabilitiesAdminTestsJSON-961045853 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82139) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 09 16:51:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-38a57cfe-7782-4ff2-b135-40f1697612cc tempest-BackendsCapabilitiesAdminTestsJSON-961045853 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82139) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 09 16:51:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Acquiring lock "cinder-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Lock "cinder-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Acquiring lock "cinder-quobyte-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Lock "cinder-quobyte-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a" acquired by "delete_volume" :: waited 0.025s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:49 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[951c9763-884d-42dc-aec2-404e46c36d59]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:49 devstack sudo[83690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a Apr 09 16:51:49 devstack sudo[83690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:50 devstack sudo[83690]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a" returned: 0 in 0.758s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:50 devstack sudo[83695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a Apr 09 16:51:50 devstack sudo[83695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:51 devstack sudo[83695]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a" returned: 0 in 0.844s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Lock "cinder-quobyte-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a" released by "delete_volume" :: held 1.658s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Created reservations ['afae12d2-fd03-4913-bcf3-7592c352d532', 'c79a3a3e-36be-4bc6-be8f-beca5acb692f', '4aab5c2a-0b66-4d26-85cf-bb1f87be55bd', 'd8f43376-8394-4b7c-a59f-1a294c088d24'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:51:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-cbf26988-042a-4a85-bce4-23b71080cb57 tempest-GroupSnapshotsV319Test-1604836189 None] Group tempest-GroupSnapshotsV319Test-Group-974062493: creating Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-cbf26988-042a-4a85-bce4-23b71080cb57 tempest-GroupSnapshotsV319Test-1604836189 None] Group tempest-GroupSnapshotsV319Test-Group-974062493: created successfully Apr 09 16:51:51 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:51:51 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-cbf26988-042a-4a85-bce4-23b71080cb57 tempest-GroupSnapshotsV319Test-1604836189 None] Create group completed successfully. Apr 09 16:51:52 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.518s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:52 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:51:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Deleted volume successfully. Apr 09 16:51:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-345c1533-fce3-4ed8-a160-243e2ce5533e tempest-DeleteServersTestJSON-1294003244 None] Lock "cinder-d3122ee0-e02d-4ecc-a40d-82aacc15ab2a-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Flow 'volume_create_manager' (09289aca-f795-452b-acc0-3bbb7ae76acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fde7f22-8b43-4d85-a1fa-378636dc0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fde7f22-8b43-4d85-a1fa-378636dc0622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1108462701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f507779-61bc-49db-a154-2a25724d1412,host='devstack@QuobyteHD#QuobyteHD',id=fa687e3f-c5c3-478c-b323-989ca39e2c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fe6ec859f7452ab4263f999f9c31c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:53Z,use_quota=True,user_id='8cb92b9b4ee8447a859f9fcbe0de3422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a26e38c4-cd99-4940-958c-b2f8fc980c44),volume_type_id=a26e38c4-cd99-4940-958c-b2f8fc980c44)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acba7adb-b365-49b2-8f1d-d4c0fa2589e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acba7adb-b365-49b2-8f1d-d4c0fa2589e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cb87bd-3e49-41f3-83aa-9adf1e98b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cb87bd-3e49-41f3-83aa-9adf1e98b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa687e3f-c5c3-478c-b323-989ca39e2c8b', 'volume_name': 'volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fecc033-a6fd-4ed5-a0a4-e0c490787ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fecc033-a6fd-4ed5-a0a4-e0c490787ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2f8455-b018-4d45-a2b0-aab1a8054d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Volume fa687e3f-c5c3-478c-b323-989ca39e2c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b', 'volume_size': 1} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f507779-61bc-49db-a154-2a25724d1412,created_at=2026-04-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1108462701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f507779-61bc-49db-a154-2a25724d1412,host='devstack@QuobyteHD#QuobyteHD',id=fa687e3f-c5c3-478c-b323-989ca39e2c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fe6ec859f7452ab4263f999f9c31c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:53Z,use_quota=True,user_id='8cb92b9b4ee8447a859f9fcbe0de3422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a26e38c4-cd99-4940-958c-b2f8fc980c44),volume_type_id=a26e38c4-cd99-4940-958c-b2f8fc980c44)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Creating volume fa687e3f-c5c3-478c-b323-989ca39e2c8b {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:51:53 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:53 devstack sudo[83707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b 1073741824 Apr 09 16:51:53 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Flow 'volume_create_manager' (ee3c4baa-2ad7-44e9-9e06-31f16cf1c730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f496d37e-5536-45c7-a888-f511ab3e3ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f496d37e-5536-45c7-a888-f511ab3e3ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-158215614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3481b9a1-6f1c-4737-8729-e2f649b88347,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f8669e8be7c483690b2d946bb1818ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:53Z,use_quota=True,user_id='c1237ad3421e4e9bab59b79bfd9b52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f992017-57bd-40ed-8d94-6b3784a43214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f992017-57bd-40ed-8d94-6b3784a43214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406f095e-ebf1-4694-851e-3fefb371591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406f095e-ebf1-4694-851e-3fefb371591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3481b9a1-6f1c-4737-8729-e2f649b88347', 'volume_name': 'volume-3481b9a1-6f1c-4737-8729-e2f649b88347', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316aa038-6776-4d29-9382-8418100a78ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316aa038-6776-4d29-9382-8418100a78ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf18b72-c76c-452b-a918-51a4108cc245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:53 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Volume 3481b9a1-6f1c-4737-8729-e2f649b88347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3481b9a1-6f1c-4737-8729-e2f649b88347', 'volume_size': 1} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:53 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b 1073741824" returned: 0 in 0.597s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:53 devstack sudo[83713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b Apr 09 16:51:53 devstack sudo[83713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:54 devstack sudo[83713]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b" returned: 0 in 0.508s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-158215614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3481b9a1-6f1c-4737-8729-e2f649b88347,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f8669e8be7c483690b2d946bb1818ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:53Z,use_quota=True,user_id='c1237ad3421e4e9bab59b79bfd9b52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Creating volume 3481b9a1-6f1c-4737-8729-e2f649b88347 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:51:54 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2f8455-b018-4d45-a2b0-aab1a8054d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:54 devstack sudo[83716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 1073741824 Apr 09 16:51:54 devstack sudo[83716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed88eba-cffe-47cc-9d72-f9beafef04d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:54 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Volume volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b (fa687e3f-c5c3-478c-b323-989ca39e2c8b): created successfully Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed88eba-cffe-47cc-9d72-f9beafef04d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Flow 'volume_create_manager' (09289aca-f795-452b-acc0-3bbb7ae76acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-9885a7d6-af72-47f7-9bae-2f9a9024e279 tempest-GroupSnapshotsV319Test-1604836189 None] Created volume successfully. Apr 09 16:51:54 devstack sudo[83716]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 1073741824" returned: 0 in 0.557s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:54 devstack sudo[83722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 Apr 09 16:51:54 devstack sudo[83722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:55 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] GroupSnapshot 578ce674-8e88-4b09-8270-946f0844c400: creating. Apr 09 16:51:55 devstack sudo[83722]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347" returned: 0 in 0.580s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf18b72-c76c-452b-a918-51a4108cc245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3481b9a1-6f1c-4737-8729-e2f649b88347', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6226f3fa-e1ba-4a0d-8bc1-deab1573adbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Group snapshot 578ce674-8e88-4b09-8270-946f0844c400: creating. {{(pid=82139) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 16:51:55 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Volume volume-3481b9a1-6f1c-4737-8729-e2f649b88347 (3481b9a1-6f1c-4737-8729-e2f649b88347): created successfully Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6226f3fa-e1ba-4a0d-8bc1-deab1573adbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Flow 'volume_create_manager' (ee3c4baa-2ad7-44e9-9e06-31f16cf1c730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:55 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-ca33eb87-6549-457b-ade0-e6a0683c67d2 req-91d6f129-15cf-464d-8b4f-cd76997fe5ee tempest-VolumesGetTestJSON-1188352196 None] Created volume successfully. Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Creating offline snapshot a40308cc-5aca-4f61-9801-0f635a06ae88 of volume fa687e3f-c5c3-478c-b323-989ca39e2c8b {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b899d0-8530-4fe1-9fc7-f0ced43b28a7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:55 devstack sudo[83725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b Apr 09 16:51:55 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:56 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b" returned: 0 in 0.508s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:56 devstack sudo[83730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 1G Apr 09 16:51:56 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:56 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 1G" returned: 0 in 0.654s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:56 devstack sudo[83736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 Apr 09 16:51:56 devstack sudo[83736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Acquiring lock "cinder-3481b9a1-6f1c-4737-8729-e2f649b88347-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Lock "cinder-3481b9a1-6f1c-4737-8729-e2f649b88347-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Acquiring lock "cinder-quobyte-3481b9a1-6f1c-4737-8729-e2f649b88347" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Lock "cinder-quobyte-3481b9a1-6f1c-4737-8729-e2f649b88347" acquired by "delete_volume" :: waited 0.030s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1d5d18-f91d-4aa0-b5f0-139443635c1c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:57 devstack sudo[83736]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88" returned: 0 in 0.568s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:57 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:57 devstack sudo[83742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 Apr 09 16:51:57 devstack sudo[83742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:57 devstack sudo[83740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 Apr 09 16:51:57 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:57 devstack sudo[83742]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88" returned: 0 in 0.616s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:58 devstack sudo[83748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.info Apr 09 16:51:58 devstack sudo[83748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:58 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347" returned: 0 in 1.077s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:58 devstack sudo[83754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347 Apr 09 16:51:58 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Flow 'volume_create_manager' (48838980-b551-4a23-a9fc-930d656c6c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aec943b-b503-496f-9115-5018b2f0b4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aec943b-b503-496f-9115-5018b2f0b4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:58Z,deleted=False,deleted_at=None,display_description='',display_name='de49cb99-c588-47f4-a7f9-72bf9be9c0e4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd42cb13-2631-4e78-bc61-1c28e150e17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30442f5ced7e43a4bb5f3a4f6564c372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:59Z,use_quota=True,user_id='cb5a20c682114d8e8b08f13c6fc7d120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51d2de4-1580-4126-8ab5-cb23186f4fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51d2de4-1580-4126-8ab5-cb23186f4fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468a1d3c-d72d-4681-b5aa-0499efe9ef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468a1d3c-d72d-4681-b5aa-0499efe9ef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd42cb13-2631-4e78-bc61-1c28e150e17c', 'volume_name': 'volume-bd42cb13-2631-4e78-bc61-1c28e150e17c', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f265cd6-ac6d-4d26-8956-2a7ce36b1357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f265cd6-ac6d-4d26-8956-2a7ce36b1357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24445b60-c237-418c-a9b5-1d3abf118513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:51:58 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Volume bd42cb13-2631-4e78-bc61-1c28e150e17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd42cb13-2631-4e78-bc61-1c28e150e17c', 'volume_size': 1} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:58 devstack sudo[83748]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.info" returned: 0 in 0.769s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:58 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:58 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.info Apr 09 16:51:58 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:58 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3481b9a1-6f1c-4737-8729-e2f649b88347" returned: 0 in 0.506s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Lock "cinder-quobyte-3481b9a1-6f1c-4737-8729-e2f649b88347" released by "delete_volume" :: held 1.616s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.quota [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Created reservations ['090f2ebd-8d0d-4084-8e14-61b6c0c92138', '4f4b9cc1-c5c6-483f-bd50-b96da0c2370c', 'a4c495ee-122a-435b-8eec-09a68cf3eb8c', '8bd4cc1e-8166-4c99-b372-ad6573b2fb10'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:58 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:51:58 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:59 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.info" returned: 0 in 0.567s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.747s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:51:58Z,deleted=False,deleted_at=None,display_description='',display_name='de49cb99-c588-47f4-a7f9-72bf9be9c0e4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd42cb13-2631-4e78-bc61-1c28e150e17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30442f5ced7e43a4bb5f3a4f6564c372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:51:59Z,use_quota=True,user_id='cb5a20c682114d8e8b08f13c6fc7d120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Creating volume bd42cb13-2631-4e78-bc61-1c28e150e17c {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:51:59 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:51:59 devstack sudo[83765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c 1073741824 Apr 09 16:51:59 devstack sudo[83765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:51:59 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-364d84e2-886f-41e7-b73c-d4faac6f23c9 tempest-GroupSnapshotsV319Test-1604836189 None] group_snapshot 578ce674-8e88-4b09-8270-946f0844c400: created successfully Apr 09 16:51:59 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.928s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG cinder.manager [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:51:59 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Deleted volume successfully. Apr 09 16:51:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-e04554fb-48be-4090-a372-44cb4504aa66 req-5f2546a9-7cb6-4696-9540-9f0f8588bb51 tempest-VolumesGetTestJSON-1188352196 None] Lock "cinder-3481b9a1-6f1c-4737-8729-e2f649b88347-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:00 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] group_snapshot 578ce674-8e88-4b09-8270-946f0844c400: deleting Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] group_snapshot 578ce674-8e88-4b09-8270-946f0844c400: deleting {{(pid=82139) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Acquiring lock "cinder-quobyte-fa687e3f-c5c3-478c-b323-989ca39e2c8b" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Lock "cinder-quobyte-fa687e3f-c5c3-478c-b323-989ca39e2c8b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Acquiring lock "cinder-quobyte-a40308cc-5aca-4f61-9801-0f635a06ae88" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Lock "cinder-quobyte-a40308cc-5aca-4f61-9801-0f635a06ae88" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Deleting offline snapshot a40308cc-5aca-4f61-9801-0f635a06ae88 of volume fa687e3f-c5c3-478c-b323-989ca39e2c8b {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] snapshot_file for this snap is: volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a25f2-8528-4d65-a278-292210a48f57]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:00 devstack sudo[83765]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c 1073741824" returned: 0 in 1.126s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:00 devstack sudo[83771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 Apr 09 16:52:00 devstack sudo[83771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:00 devstack sudo[83773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c Apr 09 16:52:00 devstack sudo[83773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:01 devstack sudo[83771]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88" returned: 0 in 0.696s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce82da7f-1c4b-4f32-8976-b3360a71592b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:01 devstack sudo[83778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b Apr 09 16:52:01 devstack sudo[83778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:01 devstack sudo[83773]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c" returned: 0 in 0.886s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24445b60-c237-418c-a9b5-1d3abf118513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd42cb13-2631-4e78-bc61-1c28e150e17c', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9c29ab-b2c7-4681-abec-8d5f76065e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:01 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Volume volume-bd42cb13-2631-4e78-bc61-1c28e150e17c (bd42cb13-2631-4e78-bc61-1c28e150e17c): created successfully Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9c29ab-b2c7-4681-abec-8d5f76065e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Flow 'volume_create_manager' (48838980-b551-4a23-a9fc-930d656c6c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:01 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-e6787b2f-fcd9-4e30-9296-42433871a35a tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Created volume successfully. Apr 09 16:52:02 devstack sudo[83778]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b" returned: 0 in 1.039s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:02 devstack sudo[83790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 Apr 09 16:52:02 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:02 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88" returned: 0 in 0.572s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:02 devstack sudo[83795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88 Apr 09 16:52:02 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:03 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b.a40308cc-5aca-4f61-9801-0f635a06ae88" returned: 0 in 0.551s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Lock "cinder-quobyte-a40308cc-5aca-4f61-9801-0f635a06ae88" released by "_delete_snapshot" :: held 2.941s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Lock "cinder-quobyte-fa687e3f-c5c3-478c-b323-989ca39e2c8b" released by "delete_snapshot" :: held 2.959s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:03 devstack cinder-volume[82139]: WARNING cinder.quota [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1486947552 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1486947552, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:03 devstack cinder-volume[82139]: WARNING cinder.quota [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1486947552 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1486947552, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:03 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] Created reservations ['3553cf93-399e-4df5-a8f2-f879f11c6e1a', '53705d5e-a49d-4070-8863-02e7fdc22979', '06941c80-47d7-4b08-91c9-686383018d4d', 'fbcf6efc-70ce-42b5-9d46-4c12dd4c2da4'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6af0ba56-547f-4a21-93f2-c28253dc157e tempest-GroupSnapshotsV319Test-1604836189 None] group_snapshot 578ce674-8e88-4b09-8270-946f0844c400: deleted successfully Apr 09 16:52:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Acquiring lock "cinder-quobyte-fa687e3f-c5c3-478c-b323-989ca39e2c8b" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "cinder-quobyte-fa687e3f-c5c3-478c-b323-989ca39e2c8b" acquired by "delete_volume" :: waited 0.028s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:03 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cedc22-451c-481c-bdeb-8ad7d338a2a4]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:03 devstack sudo[83799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b Apr 09 16:52:03 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:04 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b" returned: 0 in 0.789s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:04 devstack sudo[83804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b Apr 09 16:52:04 devstack sudo[83804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-54240b2f-89dd-4ce1-8486-916593a43609 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-54240b2f-89dd-4ce1-8486-916593a43609 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8654ec9-0e80-437f-9401-f9cdef55c794]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-54240b2f-89dd-4ce1-8486-916593a43609 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:05 devstack sudo[83804]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-fa687e3f-c5c3-478c-b323-989ca39e2c8b" returned: 0 in 0.714s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "cinder-quobyte-fa687e3f-c5c3-478c-b323-989ca39e2c8b" released by "delete_volume" :: held 1.556s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:05 devstack sudo[83815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c Apr 09 16:52:05 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Created reservations ['0359f8bc-8208-422e-bcf0-5d28d6538831'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:05 devstack cinder-volume[82139]: WARNING cinder.quota [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1486947552 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1486947552, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Created reservations ['54dbfcfa-5cf8-4cc9-817d-dafa3aea6859', 'b2dbb148-1596-4a75-a291-4d21debd629c', '4bd51fb5-6ffd-46ab-aa0d-6e5b34a62e7a', 'f9054e6c-c2db-48eb-96d0-45ea05b41714'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:05 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:52:05 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:06 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-54240b2f-89dd-4ce1-8486-916593a43609 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c" returned: 0 in 0.936s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-54240b2f-89dd-4ce1-8486-916593a43609 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.974s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:06 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-54240b2f-89dd-4ce1-8486-916593a43609 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784', 'name': 'volume-bd42cb13-2631-4e78-bc61-1c28e150e17c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3db97a63-dbc8-4908-81a5-131f5693cf2c', 'enforce_multipath': True} {{(pid=82139) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 16:52:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-74a9af30-2815-48d9-aa05-7f1ee0f5a5d8 req-54240b2f-89dd-4ce1-8486-916593a43609 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] attachment_update completed successfully. Apr 09 16:52:06 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.755s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:06 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:52:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d77c6d28-2261-4677-992e-40c781475335 tempest-GroupSnapshotsV319Test-1604836189 None] Delete group completed successfully. Apr 09 16:52:07 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c4d61881-1817-4105-8ac0-5f6d591c5b79 tempest-GroupSnapshotsTest-262244781 None] Group tempest-GroupSnapshotsTest-Group-1321747867: creating Apr 09 16:52:07 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c4d61881-1817-4105-8ac0-5f6d591c5b79 tempest-GroupSnapshotsTest-262244781 None] Group tempest-GroupSnapshotsTest-Group-1321747867: created successfully Apr 09 16:52:07 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c4d61881-1817-4105-8ac0-5f6d591c5b79 tempest-GroupSnapshotsTest-262244781 None] Create group completed successfully. Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Flow 'volume_create_manager' (24883a31-083b-489d-bd40-6b19ae14510a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c6b377-3028-4f9d-bd07-48811db8accb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c6b377-3028-4f9d-bd07-48811db8accb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324939222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7120e0b5-17df-421f-83fd-c5fa266678ab,host='devstack@QuobyteHD#QuobyteHD',id=04116b6e-ea95-4c6b-aa5c-401732a14cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ed27045d064ac59c877ce342979051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:09Z,use_quota=True,user_id='88989af34a5f4358a00c44273b97ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ef919c2-af62-4f6f-ad8c-c5390a746b83),volume_type_id=9ef919c2-af62-4f6f-ad8c-c5390a746b83)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c351126-2b46-4929-938e-5386add3ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c351126-2b46-4929-938e-5386add3ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3319540a-86e8-462e-bea2-9fdc73db37f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3319540a-86e8-462e-bea2-9fdc73db37f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04116b6e-ea95-4c6b-aa5c-401732a14cfd', 'volume_name': 'volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fff89fa-e165-43d7-ad99-01410670a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fff89fa-e165-43d7-ad99-01410670a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf4d78a-95e3-42cb-b98b-6661dedecc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:09 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Volume 04116b6e-ea95-4c6b-aa5c-401732a14cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd', 'volume_size': 1} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7120e0b5-17df-421f-83fd-c5fa266678ab,created_at=2026-04-09T14:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324939222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7120e0b5-17df-421f-83fd-c5fa266678ab,host='devstack@QuobyteHD#QuobyteHD',id=04116b6e-ea95-4c6b-aa5c-401732a14cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ed27045d064ac59c877ce342979051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:09Z,use_quota=True,user_id='88989af34a5f4358a00c44273b97ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ef919c2-af62-4f6f-ad8c-c5390a746b83),volume_type_id=9ef919c2-af62-4f6f-ad8c-c5390a746b83)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Creating volume 04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:09 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:09 devstack sudo[83898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd 1073741824 Apr 09 16:52:09 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:10 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd 1073741824" returned: 0 in 0.624s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:10 devstack sudo[83906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd Apr 09 16:52:10 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:10 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd" returned: 0 in 0.586s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf4d78a-95e3-42cb-b98b-6661dedecc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a16e3f6-b84d-4215-b595-55e55042c73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:10 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Volume volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd (04116b6e-ea95-4c6b-aa5c-401732a14cfd): created successfully Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a16e3f6-b84d-4215-b595-55e55042c73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Flow 'volume_create_manager' (24883a31-083b-489d-bd40-6b19ae14510a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:10 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8ff8f1bd-b780-4fa8-80e1-7f877964b30a tempest-GroupSnapshotsTest-262244781 None] Created volume successfully. Apr 09 16:52:11 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] GroupSnapshot 21c05678-212a-469d-9304-9694babd76f0: creating. Apr 09 16:52:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Group snapshot 21c05678-212a-469d-9304-9694babd76f0: creating. {{(pid=82139) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 16:52:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Creating offline snapshot 752ae9c1-b29e-4dca-b8d9-aec78108dd43 of volume 04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:52:11 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[451c9f69-b0ee-41aa-bf63-bbf7a760a86c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:12 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd Apr 09 16:52:12 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:12 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd" returned: 0 in 0.648s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:12 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 1G Apr 09 16:52:12 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:13 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 1G" returned: 0 in 0.620s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:13 devstack sudo[84258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 Apr 09 16:52:13 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:13 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43" returned: 0 in 0.608s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:13 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:52:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:13 devstack sudo[84266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 Apr 09 16:52:13 devstack sudo[84266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:14 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:52:14 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:14 devstack sudo[84266]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43" returned: 0 in 0.731s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:14 devstack sudo[84273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.info Apr 09 16:52:14 devstack sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:14 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.545s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:52:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eb592104-59ad-42cb-ba95-47873005774d tempest-GroupsTest-652070532 None] Group tempest-Group1-1237272637: creating Apr 09 16:52:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eb592104-59ad-42cb-ba95-47873005774d tempest-GroupsTest-652070532 None] Group tempest-Group1-1237272637: created successfully Apr 09 16:52:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eb592104-59ad-42cb-ba95-47873005774d tempest-GroupsTest-652070532 None] Create group completed successfully. Apr 09 16:52:15 devstack sudo[84273]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.info" returned: 0 in 0.556s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:15 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:52:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:15 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.info Apr 09 16:52:15 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:15 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.info" returned: 0 in 0.432s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.697s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:15 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-91a3f5f7-331d-40b1-ad74-b39609556a2d tempest-GroupSnapshotsTest-262244781 None] group_snapshot 21c05678-212a-469d-9304-9694babd76f0: created successfully Apr 09 16:52:15 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2f6ddb5c-1d6a-4726-a58d-e9c663947d85 tempest-GroupsTest-652070532 None] Group tempest-Group2-1784845275: creating Apr 09 16:52:15 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2f6ddb5c-1d6a-4726-a58d-e9c663947d85 tempest-GroupsTest-652070532 None] Group tempest-Group2-1784845275: created successfully Apr 09 16:52:15 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2f6ddb5c-1d6a-4726-a58d-e9c663947d85 tempest-GroupsTest-652070532 None] Create group completed successfully. Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=104,cinder:SELECT=94,cinder:INSERT=24,cinder:DELETE=9 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-752ae9c1-b29e-4dca-b8d9-aec78108dd43-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" by "_create_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-752ae9c1-b29e-4dca-b8d9-aec78108dd43-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Creating volume ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b from snapshot 752ae9c1-b29e-4dca-b8d9-aec78108dd43 {{(pid=82139) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] snapshot: 752ae9c1-b29e-4dca-b8d9-aec78108dd43, volume: ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a308fef5-c25d-43fc-a334-c4ebe208c83f]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:17 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 Apr 09 16:52:17 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=98,cinder:UPDATE=103,cinder:INSERT=20,cinder:DELETE=6 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Flow 'volume_create_manager' (8d80933a-58be-413e-b3ee-a431fa01ad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d7a311-b5cc-4eca-9e93-54d1ef87d5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d7a311-b5cc-4eca-9e93-54d1ef87d5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1238237880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d14fefa4-3158-4eb3-8c24-05cb351a20b3,host='devstack@QuobyteHD#QuobyteHD',id=6338d24d-1816-4630-ab04-3f71e4b71d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa00c23b67634f419a4dc3e337b8421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:17Z,use_quota=True,user_id='27358b1d98a94a73859177d70d095cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27f03ac5-b5ed-449a-9ed0-95a1b96d6a6b),volume_type_id=27f03ac5-b5ed-449a-9ed0-95a1b96d6a6b)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a66a4e4-99f7-40a2-9bd3-009dbc78acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a66a4e4-99f7-40a2-9bd3-009dbc78acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d646529b-d3fa-4510-8dd9-02d72d9ece48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d646529b-d3fa-4510-8dd9-02d72d9ece48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6338d24d-1816-4630-ab04-3f71e4b71d7e', 'volume_name': 'volume-6338d24d-1816-4630-ab04-3f71e4b71d7e', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fef10f6-b9d5-4351-a586-5e2974e80478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fef10f6-b9d5-4351-a586-5e2974e80478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b2ecc7-1424-46ae-b875-c2ab17f4dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:17 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Volume 6338d24d-1816-4630-ab04-3f71e4b71d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6338d24d-1816-4630-ab04-3f71e4b71d7e', 'volume_size': 1} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:17 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43" returned: 0 in 0.489s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5dd09-bf75-4c81-99f1-692206dc4eee]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:17 devstack sudo[84303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd Apr 09 16:52:17 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:18 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd" returned: 0 in 0.607s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:18 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:52:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:18 devstack sudo[84308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b Apr 09 16:52:18 devstack sudo[84308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:21 devstack sudo[84308]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" returned: 0 in 3.160s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:21 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc231e1-2e47-4f21-b079-4b579f8b5b19]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:21 devstack sudo[84398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd Apr 09 16:52:21 devstack sudo[84398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:22 devstack sudo[84398]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd" returned: 0 in 0.826s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd, size 1024.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:52:22 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Converted 1024.00 MB image at 323.88 MB/s Apr 09 16:52:22 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:22 devstack sudo[84419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b Apr 09 16:52:22 devstack sudo[84419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:22 devstack sudo[84419]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" returned: 0 in 0.440s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" released by "_copy_volume_from_snapshot" :: held 5.584s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-752ae9c1-b29e-4dca-b8d9-aec78108dd43-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" released by "_create_volume_from_snapshot" :: held 5.611s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.620s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.171s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d14fefa4-3158-4eb3-8c24-05cb351a20b3,created_at=2026-04-09T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1238237880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d14fefa4-3158-4eb3-8c24-05cb351a20b3,host='devstack@QuobyteHD#QuobyteHD',id=6338d24d-1816-4630-ab04-3f71e4b71d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa00c23b67634f419a4dc3e337b8421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:17Z,use_quota=True,user_id='27358b1d98a94a73859177d70d095cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27f03ac5-b5ed-449a-9ed0-95a1b96d6a6b),volume_type_id=27f03ac5-b5ed-449a-9ed0-95a1b96d6a6b)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Creating volume 6338d24d-1816-4630-ab04-3f71e4b71d7e {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:22 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:22 devstack sudo[84428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e 1073741824 Apr 09 16:52:22 devstack sudo[84428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:22 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-554d7fcf-9ea6-4bad-ab67-273ad4c8d65a tempest-GroupSnapshotsTest-262244781 None] Create group from source-snapshot-21c05678-212a-469d-9304-9694babd76f0 completed successfully. Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:22 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc8b16c-fec7-496e-8fd2-0665349b4f44]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:23 devstack sudo[84433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b Apr 09 16:52:23 devstack sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:23 devstack sudo[84428]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e 1073741824" returned: 0 in 0.616s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:23 devstack sudo[84435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e Apr 09 16:52:23 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:23 devstack sudo[84433]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" returned: 0 in 0.581s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:23 devstack sudo[84442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b Apr 09 16:52:23 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:23 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e" returned: 0 in 0.625s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b2ecc7-1424-46ae-b875-c2ab17f4dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6338d24d-1816-4630-ab04-3f71e4b71d7e', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792741f9-0e5a-41d5-b97c-bc73f057fc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:23 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Volume volume-6338d24d-1816-4630-ab04-3f71e4b71d7e (6338d24d-1816-4630-ab04-3f71e4b71d7e): created successfully Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792741f9-0e5a-41d5-b97c-bc73f057fc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Flow 'volume_create_manager' (8d80933a-58be-413e-b3ee-a431fa01ad54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:23 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c98f664d-3a95-4a55-929f-ef823ea58d97 tempest-GroupsTest-652070532 None] Created volume successfully. Apr 09 16:52:24 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" returned: 0 in 0.546s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-ff7502c0-dd8f-4115-ad45-2cc25ed6ba6b" released by "delete_volume" :: held 1.168s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Created reservations ['a6207c0f-ea44-4296-8c6f-16495330b9e2'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:24 devstack cinder-volume[82139]: WARNING cinder.quota [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-876254131 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-876254131, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:24 devstack cinder-volume[82139]: WARNING cinder.quota [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-876254131 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-876254131, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Created reservations ['0565b8bf-34e2-4c4c-bc27-1c7f911c9a07', '7d3d1cca-5856-4360-824b-8a0f37769318', '7ca1c5f4-74e0-4539-8065-64653dd31304', 'df18ddc1-b886-486d-b238-7e4fac76d0e7'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:24 devstack sudo[84447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:52:24 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Acquiring lock "cinder-quobyte-6338d24d-1816-4630-ab04-3f71e4b71d7e" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Lock "cinder-quobyte-6338d24d-1816-4630-ab04-3f71e4b71d7e" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc8fd03-17e2-41d4-b3cf-9943c0455340]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:24 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e Apr 09 16:52:24 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:24 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.459s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:24 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:52:24 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-198db56c-da29-4b7d-b714-be5439529128 tempest-GroupSnapshotsTest-262244781 None] Delete group completed successfully. Apr 09 16:52:25 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e" returned: 0 in 0.556s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:25 devstack sudo[84459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e Apr 09 16:52:25 devstack sudo[84459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:25 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] group_snapshot 21c05678-212a-469d-9304-9694babd76f0: deleting Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] group_snapshot 21c05678-212a-469d-9304-9694babd76f0: deleting {{(pid=82139) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-04116b6e-ea95-4c6b-aa5c-401732a14cfd" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-04116b6e-ea95-4c6b-aa5c-401732a14cfd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-752ae9c1-b29e-4dca-b8d9-aec78108dd43" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-752ae9c1-b29e-4dca-b8d9-aec78108dd43" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Deleting offline snapshot 752ae9c1-b29e-4dca-b8d9-aec78108dd43 of volume 04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] snapshot_file for this snap is: volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b28438-4193-44a9-a0f8-08bc55c7a922]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:25 devstack sudo[84463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 Apr 09 16:52:25 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:25 devstack sudo[84459]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6338d24d-1816-4630-ab04-3f71e4b71d7e" returned: 0 in 0.450s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Lock "cinder-quobyte-6338d24d-1816-4630-ab04-3f71e4b71d7e" released by "delete_volume" :: held 1.033s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Created reservations ['fbc4134a-ad05-4752-9761-0b73fb346a16'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:25 devstack cinder-volume[82139]: WARNING cinder.quota [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-772362855 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-772362855, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:25 devstack cinder-volume[82139]: WARNING cinder.quota [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-772362855 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-772362855, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Created reservations ['028315b4-8fbf-48df-a476-a1aa6e67f0af', '0c2bd04e-291f-4979-8088-beb2f37e1316', '9b94ad4a-f5b6-4a99-b748-e733d25eed9d', 'd87027ea-3f89-4613-ae5b-8ede0cc16aab'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:25 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:52:25 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:25 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43" returned: 0 in 0.492s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c29310b-44bf-4e91-b3ea-19113f23dd28]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:25 devstack sudo[84471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd Apr 09 16:52:25 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:26 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.414s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:52:26 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eb7ba0d8-722f-4ef5-81d5-28e0ee526875 tempest-GroupsTest-652070532 None] Delete group completed successfully. Apr 09 16:52:26 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd" returned: 0 in 0.681s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:26 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 Apr 09 16:52:26 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Created reservations ['51aad20e-4cf9-45bc-9d5a-b8b31e50d015'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:27 devstack sudo[84507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:52:27 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:27 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43" returned: 0 in 0.926s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:27 devstack sudo[84513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43 Apr 09 16:52:27 devstack sudo[84513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:27 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.605s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:27 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:52:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4cb5f0e8-23e3-4ef0-8bf7-c07816c527e8 tempest-GroupsTest-652070532 None] Delete group completed successfully. Apr 09 16:52:28 devstack sudo[84513]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd.752ae9c1-b29e-4dca-b8d9-aec78108dd43" returned: 0 in 0.821s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-752ae9c1-b29e-4dca-b8d9-aec78108dd43" released by "_delete_snapshot" :: held 3.030s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-04116b6e-ea95-4c6b-aa5c-401732a14cfd" released by "delete_snapshot" :: held 3.044s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:28 devstack cinder-volume[82139]: WARNING cinder.quota [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-876254131 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-876254131, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:28 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] Created reservations ['af112b60-e4d9-4bf0-9836-22e6e7bd506a', 'b276d422-d69f-454a-92b1-e505d6056763', 'b48b3efc-4423-424b-b753-177602da6184', '48eb4c86-7557-4cb2-934d-f966f5a561f6'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eb1feed2-7e3c-451f-a488-2f9323cc2d17 tempest-GroupsTest-652070532 None] Group tempest-GroupsTest-Group-1868517556: creating Apr 09 16:52:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eb1feed2-7e3c-451f-a488-2f9323cc2d17 tempest-GroupsTest-652070532 None] Group tempest-GroupsTest-Group-1868517556: created successfully Apr 09 16:52:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-76c3940c-4863-4011-bf61-7fa066a6fc5d tempest-GroupSnapshotsTest-262244781 None] group_snapshot 21c05678-212a-469d-9304-9694babd76f0: deleted successfully Apr 09 16:52:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eb1feed2-7e3c-451f-a488-2f9323cc2d17 tempest-GroupsTest-652070532 None] Create group completed successfully. Apr 09 16:52:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-04116b6e-ea95-4c6b-aa5c-401732a14cfd" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-04116b6e-ea95-4c6b-aa5c-401732a14cfd" acquired by "delete_volume" :: waited 0.031s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd0fed8-5a1f-4164-93bb-295bcc0f39c2]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Flow 'volume_create_manager' (2e0544f1-f90d-49ec-90eb-7fe049ee1a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4362c18-c942-4774-916d-116ce9d523f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4362c18-c942-4774-916d-116ce9d523f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-254333811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e106fa59-6e98-4980-83b7-d4ab58b5178f,host='devstack@QuobyteHD#QuobyteHD',id=38a6ccc8-43ff-420d-a101-7a91241f9197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa00c23b67634f419a4dc3e337b8421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:30Z,use_quota=True,user_id='27358b1d98a94a73859177d70d095cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8151623-577b-4ebe-a469-5677a8858f6d),volume_type_id=b8151623-577b-4ebe-a469-5677a8858f6d)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a3a97b-0b24-4410-852f-2400d30e63f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a3a97b-0b24-4410-852f-2400d30e63f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ffa2b2-d6ce-4522-a530-446c68dc647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ffa2b2-d6ce-4522-a530-446c68dc647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a6ccc8-43ff-420d-a101-7a91241f9197', 'volume_name': 'volume-38a6ccc8-43ff-420d-a101-7a91241f9197', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e4c73e-a5da-4ed0-a076-022d26e82797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e4c73e-a5da-4ed0-a076-022d26e82797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7144e797-d93b-4fc5-a015-b463f46b32f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:30 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Volume 38a6ccc8-43ff-420d-a101-7a91241f9197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a6ccc8-43ff-420d-a101-7a91241f9197', 'volume_size': 1} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e106fa59-6e98-4980-83b7-d4ab58b5178f,created_at=2026-04-09T14:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-254333811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e106fa59-6e98-4980-83b7-d4ab58b5178f,host='devstack@QuobyteHD#QuobyteHD',id=38a6ccc8-43ff-420d-a101-7a91241f9197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa00c23b67634f419a4dc3e337b8421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:30Z,use_quota=True,user_id='27358b1d98a94a73859177d70d095cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8151623-577b-4ebe-a469-5677a8858f6d),volume_type_id=b8151623-577b-4ebe-a469-5677a8858f6d)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Creating volume 38a6ccc8-43ff-420d-a101-7a91241f9197 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:30 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:30 devstack sudo[84553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 1073741824 Apr 09 16:52:30 devstack sudo[84553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:30 devstack sudo[84549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd Apr 09 16:52:30 devstack sudo[84549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:31 devstack sudo[84549]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd" returned: 0 in 1.597s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:31 devstack sudo[84641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd Apr 09 16:52:31 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:31 devstack sudo[84553]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 1073741824" returned: 0 in 1.622s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:31 devstack sudo[84646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 Apr 09 16:52:31 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:32 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-04116b6e-ea95-4c6b-aa5c-401732a14cfd" returned: 0 in 0.929s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-04116b6e-ea95-4c6b-aa5c-401732a14cfd" released by "delete_volume" :: held 2.630s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Created reservations ['1bf90154-12c2-427b-aea8-1fa9f7271aaf'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:32 devstack cinder-volume[82139]: WARNING cinder.db.sqlalchemy.api [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-876254131'] Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Created reservations ['a1a879aa-e9f5-4a08-aad7-cb44a4f1cec3', '68c1240c-3908-4379-b0b1-15de2809db44', '2e1a4693-1712-4b97-838d-166de211c15f', 'f783f053-0466-49fe-83cd-60624bb94f30'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:32 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197" returned: 0 in 0.804s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] <== create_volume: return (2480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.482s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7144e797-d93b-4fc5-a015-b463f46b32f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a6ccc8-43ff-420d-a101-7a91241f9197', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11159db9-67a5-406b-9d0f-7aecab55bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:32 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Volume volume-38a6ccc8-43ff-420d-a101-7a91241f9197 (38a6ccc8-43ff-420d-a101-7a91241f9197): created successfully Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11159db9-67a5-406b-9d0f-7aecab55bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Flow 'volume_create_manager' (2e0544f1-f90d-49ec-90eb-7fe049ee1a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:32 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-97c97d30-a50a-44df-b01a-1f18dd874527 tempest-GroupsTest-652070532 None] Created volume successfully. Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:32 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:52:32 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:33 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:52:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4185be17-3eef-4849-8d11-19c7c9d3b1a2 tempest-GroupSnapshotsTest-262244781 None] Delete group completed successfully. Apr 09 16:52:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-87a8b3eb-eb0d-4c34-b047-6bab32065b3e tempest-GroupSnapshotsTest-262244781 None] Group tempest-GroupSnapshotsTest-Group-821189951: creating Apr 09 16:52:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-87a8b3eb-eb0d-4c34-b047-6bab32065b3e tempest-GroupSnapshotsTest-262244781 None] Group tempest-GroupSnapshotsTest-Group-821189951: created successfully Apr 09 16:52:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-87a8b3eb-eb0d-4c34-b047-6bab32065b3e tempest-GroupSnapshotsTest-262244781 None] Create group completed successfully. Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Flow 'volume_create_manager' (34ca4c73-a97a-4bd4-86af-df85a1d006a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec26c3b-cb7a-4056-9ad9-e18573a25896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec26c3b-cb7a-4056-9ad9-e18573a25896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1577475476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e106fa59-6e98-4980-83b7-d4ab58b5178f,host='devstack@QuobyteHD#QuobyteHD',id=93993aa4-1db0-4763-9744-bc461c340fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa00c23b67634f419a4dc3e337b8421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:34Z,use_quota=True,user_id='27358b1d98a94a73859177d70d095cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8151623-577b-4ebe-a469-5677a8858f6d),volume_type_id=b8151623-577b-4ebe-a469-5677a8858f6d)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541c4e62-2fa5-40bc-b5e0-417bf47cc6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541c4e62-2fa5-40bc-b5e0-417bf47cc6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da01378-76d3-419e-980f-d94feb9fa188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da01378-76d3-419e-980f-d94feb9fa188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93993aa4-1db0-4763-9744-bc461c340fda', 'volume_name': 'volume-93993aa4-1db0-4763-9744-bc461c340fda', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7aca2f-d1e5-4eeb-be15-9e6e9face25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7aca2f-d1e5-4eeb-be15-9e6e9face25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c550859-f3e3-4061-a3d2-b34d86f35263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:34 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Volume 93993aa4-1db0-4763-9744-bc461c340fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93993aa4-1db0-4763-9744-bc461c340fda', 'volume_size': 1} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e106fa59-6e98-4980-83b7-d4ab58b5178f,created_at=2026-04-09T14:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1577475476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e106fa59-6e98-4980-83b7-d4ab58b5178f,host='devstack@QuobyteHD#QuobyteHD',id=93993aa4-1db0-4763-9744-bc461c340fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa00c23b67634f419a4dc3e337b8421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:34Z,use_quota=True,user_id='27358b1d98a94a73859177d70d095cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8151623-577b-4ebe-a469-5677a8858f6d),volume_type_id=b8151623-577b-4ebe-a469-5677a8858f6d)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Creating volume 93993aa4-1db0-4763-9744-bc461c340fda {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:34 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:34 devstack sudo[84690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda 1073741824 Apr 09 16:52:34 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:34 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda 1073741824" returned: 0 in 0.798s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:34 devstack sudo[84702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda Apr 09 16:52:34 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Flow 'volume_create_manager' (8ee0604c-e4a2-4d9e-a427-b25d44c2b195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a354ff-27b3-4701-89a7-5833e3968077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a354ff-27b3-4701-89a7-5833e3968077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1224263839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea441ca1-5d30-439f-8131-7a1cf0884e05,host='devstack@QuobyteHD#QuobyteHD',id=7c0709c8-f52a-4f53-8540-cafeed25dba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ed27045d064ac59c877ce342979051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:35Z,use_quota=True,user_id='88989af34a5f4358a00c44273b97ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52760303-a1ef-4574-acbf-1c2424fe857a),volume_type_id=52760303-a1ef-4574-acbf-1c2424fe857a)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99736b78-b7ad-47e6-9289-3cb2f2fe468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99736b78-b7ad-47e6-9289-3cb2f2fe468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279f2bf5-9df0-47bf-a182-2151e19cb025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279f2bf5-9df0-47bf-a182-2151e19cb025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0709c8-f52a-4f53-8540-cafeed25dba2', 'volume_name': 'volume-7c0709c8-f52a-4f53-8540-cafeed25dba2', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440733b4-a02e-4d12-b284-fe11bccb2071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440733b4-a02e-4d12-b284-fe11bccb2071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77939010-6a13-49cb-bae4-4d531bdcea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:35 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Volume 7c0709c8-f52a-4f53-8540-cafeed25dba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0709c8-f52a-4f53-8540-cafeed25dba2', 'volume_size': 1} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:35 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda" returned: 0 in 0.545s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea441ca1-5d30-439f-8131-7a1cf0884e05,created_at=2026-04-09T14:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1224263839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea441ca1-5d30-439f-8131-7a1cf0884e05,host='devstack@QuobyteHD#QuobyteHD',id=7c0709c8-f52a-4f53-8540-cafeed25dba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ed27045d064ac59c877ce342979051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:35Z,use_quota=True,user_id='88989af34a5f4358a00c44273b97ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52760303-a1ef-4574-acbf-1c2424fe857a),volume_type_id=52760303-a1ef-4574-acbf-1c2424fe857a)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Creating volume 7c0709c8-f52a-4f53-8540-cafeed25dba2 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:35 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c550859-f3e3-4061-a3d2-b34d86f35263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93993aa4-1db0-4763-9744-bc461c340fda', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:35 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 1073741824 Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f9095b-9461-44d2-b266-c1545542b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:35 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:35 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Volume volume-93993aa4-1db0-4763-9744-bc461c340fda (93993aa4-1db0-4763-9744-bc461c340fda): created successfully Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f9095b-9461-44d2-b266-c1545542b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Flow 'volume_create_manager' (34ca4c73-a97a-4bd4-86af-df85a1d006a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:35 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e4543eb5-169c-42a9-bf85-b75815e36845 tempest-GroupsTest-652070532 None] Created volume successfully. Apr 09 16:52:35 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 1073741824" returned: 0 in 0.565s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:36 devstack sudo[84712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 Apr 09 16:52:36 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-11d80250-4fa8-4f94-a698-c81de930a79c tempest-GroupsTest-652070532 None] Update group completed successfully. Apr 09 16:52:36 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2" returned: 0 in 0.639s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77939010-6a13-49cb-bae4-4d531bdcea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0709c8-f52a-4f53-8540-cafeed25dba2', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc580c9-072c-4310-a40a-cfc31f85a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:36 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Volume volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 (7c0709c8-f52a-4f53-8540-cafeed25dba2): created successfully Apr 09 16:52:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc580c9-072c-4310-a40a-cfc31f85a21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Flow 'volume_create_manager' (8ee0604c-e4a2-4d9e-a427-b25d44c2b195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-27207863-ce90-49a9-a621-8e0d360cef66 tempest-GroupSnapshotsTest-262244781 None] Created volume successfully. Apr 09 16:52:37 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-de12c309-a77f-475c-94d2-01cdfb178048 tempest-GroupsTest-652070532 None] Update group completed successfully. Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Flow 'volume_create_manager' (3e426b1b-a856-4c57-b79c-a258b8ddd605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07aedf6a-8ba7-42df-84ff-c6ad092810fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07aedf6a-8ba7-42df-84ff-c6ad092810fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-74946796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea441ca1-5d30-439f-8131-7a1cf0884e05,host='devstack@QuobyteHD#QuobyteHD',id=cc69ddf9-3188-4b8c-97ea-d6cce7e69666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ed27045d064ac59c877ce342979051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:38Z,use_quota=True,user_id='88989af34a5f4358a00c44273b97ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52760303-a1ef-4574-acbf-1c2424fe857a),volume_type_id=52760303-a1ef-4574-acbf-1c2424fe857a)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfac54d0-f1a7-4d27-b938-c0c7fa38ef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfac54d0-f1a7-4d27-b938-c0c7fa38ef9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6db795f-10b9-4c0d-be4b-abcaa73eb316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6db795f-10b9-4c0d-be4b-abcaa73eb316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc69ddf9-3188-4b8c-97ea-d6cce7e69666', 'volume_name': 'volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9395b9-beb7-40e1-8498-58211a8ad9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9395b9-beb7-40e1-8498-58211a8ad9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962b2925-706f-42c0-8ec1-a4c1cdfa018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:37 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Volume cc69ddf9-3188-4b8c-97ea-d6cce7e69666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666', 'volume_size': 1} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea441ca1-5d30-439f-8131-7a1cf0884e05,created_at=2026-04-09T14:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-74946796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea441ca1-5d30-439f-8131-7a1cf0884e05,host='devstack@QuobyteHD#QuobyteHD',id=cc69ddf9-3188-4b8c-97ea-d6cce7e69666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ed27045d064ac59c877ce342979051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:38Z,use_quota=True,user_id='88989af34a5f4358a00c44273b97ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52760303-a1ef-4574-acbf-1c2424fe857a),volume_type_id=52760303-a1ef-4574-acbf-1c2424fe857a)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Creating volume cc69ddf9-3188-4b8c-97ea-d6cce7e69666 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:38 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:38 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 1073741824 Apr 09 16:52:38 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:38 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 1073741824" returned: 0 in 0.758s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:38 devstack sudo[84753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 Apr 09 16:52:38 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Acquiring lock "cinder-quobyte-38a6ccc8-43ff-420d-a101-7a91241f9197" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Lock "cinder-quobyte-38a6ccc8-43ff-420d-a101-7a91241f9197" acquired by "delete_volume" :: waited 0.015s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6accd5-e51b-4daa-9554-459254d6753e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:39 devstack sudo[84756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 Apr 09 16:52:39 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:39 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" returned: 0 in 0.973s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962b2925-706f-42c0-8ec1-a4c1cdfa018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:39 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ecc817-d421-4a94-b354-3da39f7a7f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197" returned: 0 in 0.840s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Volume volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 (cc69ddf9-3188-4b8c-97ea-d6cce7e69666): created successfully Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ecc817-d421-4a94-b354-3da39f7a7f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Flow 'volume_create_manager' (3e426b1b-a856-4c57-b79c-a258b8ddd605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:39 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3c8f29ce-e122-4e59-a6e6-f2475c76f628 tempest-GroupSnapshotsTest-262244781 None] Created volume successfully. Apr 09 16:52:39 devstack sudo[84786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197 Apr 09 16:52:39 devstack sudo[84786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:40 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6cf796fa-c148-4063-b4f6-99489e110520 tempest-GroupSnapshotsTest-262244781 None] Update group completed successfully. Apr 09 16:52:40 devstack sudo[84786]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38a6ccc8-43ff-420d-a101-7a91241f9197" returned: 0 in 0.732s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Lock "cinder-quobyte-38a6ccc8-43ff-420d-a101-7a91241f9197" released by "delete_volume" :: held 1.599s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Acquiring lock "cinder-quobyte-93993aa4-1db0-4763-9744-bc461c340fda" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Lock "cinder-quobyte-93993aa4-1db0-4763-9744-bc461c340fda" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:40 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5ab075-6939-45ed-adf2-647c41f7cf4e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:40 devstack sudo[84790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda Apr 09 16:52:40 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:41 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda" returned: 0 in 0.532s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:41 devstack sudo[84800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda Apr 09 16:52:41 devstack sudo[84800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:41 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-b6a1a0de-135c-4c05-8a17-585c38452726 tempest-GroupSnapshotsTest-262244781 None] Update group completed successfully. Apr 09 16:52:41 devstack sudo[84800]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-93993aa4-1db0-4763-9744-bc461c340fda" returned: 0 in 0.583s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Lock "cinder-quobyte-93993aa4-1db0-4763-9744-bc461c340fda" released by "delete_volume" :: held 1.136s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Created reservations ['9dd8728e-51f1-4e68-bb93-f98dd740c6dd'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:41 devstack cinder-volume[82139]: WARNING cinder.quota [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1158461031 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1158461031, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:41 devstack cinder-volume[82139]: WARNING cinder.quota [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1158461031 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1158461031, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Created reservations ['3e0064a5-005a-49c4-bbc2-a111f933aebc', '5310489a-2027-4301-b8db-a9b6fdbfa152', '662fad03-cd0d-479a-bb4b-c07e0e6e930b', '4a50bd83-2838-4705-bc4a-42cca860d2d0'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Created reservations ['67d7e9c8-7a5c-4583-bca3-5cb4e9384768', '7f20e7e3-120e-4d36-a883-9d6a5ff5a01f', '471aa782-eeb1-4213-9cd2-26a6dc290c08', 'd8a7ac4f-4056-43f7-b015-e8c966d2a1f2'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:41 devstack sudo[84818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:52:41 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:42 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:42 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:52:42 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c3e1ad3a-28c6-47ff-af1c-3b384d347417 tempest-GroupsTest-652070532 None] Delete group completed successfully. Apr 09 16:52:42 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-96526453-c489-460d-b2e7-ed91a0c9c5b3 tempest-GroupSnapshotsTest-262244781 None] Update group completed successfully. Apr 09 16:52:43 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-feb48841-1a5d-4dc4-a523-233162be4a1e tempest-GroupSnapshotsTest-262244781 None] Update group completed successfully. Apr 09 16:52:45 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] GroupSnapshot c60fb4c6-643f-43a5-a96d-1a70edabf620: creating. Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Group snapshot c60fb4c6-643f-43a5-a96d-1a70edabf620: creating. {{(pid=82139) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Creating offline snapshot 3f3d4984-7551-4d71-9f8f-6d96f18d2f1e of volume cc69ddf9-3188-4b8c-97ea-d6cce7e69666 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea0d463-b2c9-4b12-b8a6-8475b1a23a2c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Flow 'volume_create_manager' (2d1754de-8961-4fa9-96ba-f9e08805a481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac42128-215f-4271-a506-844c90c6e810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac42128-215f-4271-a506-844c90c6e810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-956000535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffea3e7-1923-4e08-a1c6-083218323eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33133bc73d3e4b10a259963d233ef084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:45Z,use_quota=True,user_id='e280cd0f1609420f8bffaca5bc3e39c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:45 devstack sudo[84835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 Apr 09 16:52:45 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b5a6ae-0489-40a6-89f3-d0f45c64b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b5a6ae-0489-40a6-89f3-d0f45c64b007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2a692e-5ded-474d-a0b2-72670ab17875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2a692e-5ded-474d-a0b2-72670ab17875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffea3e7-1923-4e08-a1c6-083218323eb9', 'volume_name': 'volume-9ffea3e7-1923-4e08-a1c6-083218323eb9', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54c95b8-8ef5-4399-8370-0259d5453fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54c95b8-8ef5-4399-8370-0259d5453fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48b208c-ab5e-42d2-9186-d6d08432d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:45 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Volume 9ffea3e7-1923-4e08-a1c6-083218323eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffea3e7-1923-4e08-a1c6-083218323eb9', 'volume_size': 1} Apr 09 16:52:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:46 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" returned: 0 in 0.657s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:46 devstack sudo[84861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e 1G Apr 09 16:52:46 devstack sudo[84861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:47 devstack sudo[84861]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e 1G" returned: 0 in 1.364s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:47 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e Apr 09 16:52:47 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:48 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e" returned: 0 in 0.571s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:48 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:52:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:48 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e Apr 09 16:52:48 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:48 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e" returned: 0 in 0.795s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:49 devstack sudo[84884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.info Apr 09 16:52:49 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:49 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.info" returned: 0 in 0.747s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:49 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:52:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:49 devstack sudo[84887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.info Apr 09 16:52:49 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:50 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.info" returned: 0 in 0.570s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.880s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Creating offline snapshot 71721246-4630-4800-972a-0e516cd794ec of volume 7c0709c8-f52a-4f53-8540-cafeed25dba2 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[25814882-e3f8-468e-812e-36145b4fc767]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:50 devstack sudo[84891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 Apr 09 16:52:50 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:50 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2" returned: 0 in 0.638s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:51 devstack sudo[84897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec 1G Apr 09 16:52:51 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:51 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec 1G" returned: 0 in 0.629s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:51 devstack sudo[84902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec Apr 09 16:52:51 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Flow 'volume_create_manager' (ad9e5d68-5462-48e3-b449-64e38cd0765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8751c524-cf3f-4d6f-9d1a-8fc702c65668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8751c524-cf3f-4d6f-9d1a-8fc702c65668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-996048342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0701020-e66a-4a52-9f98-c266f8bea8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32211318bffb4909a4191816e1d93d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:52Z,use_quota=True,user_id='cb6f3da4cb52407681bf56bfa19a034e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9dd575-2634-48d1-97ab-8ae207d7a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9dd575-2634-48d1-97ab-8ae207d7a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f028d96-fd84-4047-895c-2dcf8f1149a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f028d96-fd84-4047-895c-2dcf8f1149a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0701020-e66a-4a52-9f98-c266f8bea8db', 'volume_name': 'volume-d0701020-e66a-4a52-9f98-c266f8bea8db', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59480ae-7c36-44d0-8709-e5b7f5b12b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59480ae-7c36-44d0-8709-e5b7f5b12b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a998d278-a53f-4ee2-90c2-6207ecc1540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:51 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Volume d0701020-e66a-4a52-9f98-c266f8bea8db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0701020-e66a-4a52-9f98-c266f8bea8db', 'volume_size': 1} Apr 09 16:52:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:52 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec" returned: 0 in 0.552s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:52 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:52:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:52 devstack sudo[84907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec Apr 09 16:52:52 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:52 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec" returned: 0 in 0.456s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:52 devstack sudo[84910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.info Apr 09 16:52:52 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:53 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.info" returned: 0 in 0.490s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:53 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:53 devstack sudo[84917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.info Apr 09 16:52:53 devstack sudo[84917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:53 devstack sudo[84917]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.info" returned: 0 in 0.482s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.319s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.997s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-956000535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffea3e7-1923-4e08-a1c6-083218323eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33133bc73d3e4b10a259963d233ef084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:45Z,use_quota=True,user_id='e280cd0f1609420f8bffaca5bc3e39c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Creating volume 9ffea3e7-1923-4e08-a1c6-083218323eb9 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:53 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:53 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 1073741824 Apr 09 16:52:53 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:53 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6e6e4a73-0c31-415d-a05b-8fabba8e1ed8 tempest-GroupSnapshotsTest-262244781 None] group_snapshot c60fb4c6-643f-43a5-a96d-1a70edabf620: created successfully Apr 09 16:52:53 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] group_snapshot c60fb4c6-643f-43a5-a96d-1a70edabf620: deleting Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] group_snapshot c60fb4c6-643f-43a5-a96d-1a70edabf620: deleting {{(pid=82139) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 16:52:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-3f3d4984-7551-4d71-9f8f-6d96f18d2f1e" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-3f3d4984-7551-4d71-9f8f-6d96f18d2f1e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Deleting offline snapshot 3f3d4984-7551-4d71-9f8f-6d96f18d2f1e of volume cc69ddf9-3188-4b8c-97ea-d6cce7e69666 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] snapshot_file for this snap is: volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[181531eb-c52b-477e-b333-5156560a7d82]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:54 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e Apr 09 16:52:54 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:54 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 1073741824" returned: 0 in 0.753s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:54 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 Apr 09 16:52:54 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:54 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e" returned: 0 in 0.616s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5783b6bc-8cae-472b-bda6-e1b55cb03d0a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:54 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9" returned: 0 in 0.433s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.948s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-996048342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0701020-e66a-4a52-9f98-c266f8bea8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32211318bffb4909a4191816e1d93d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:52Z,use_quota=True,user_id='cb6f3da4cb52407681bf56bfa19a034e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Creating volume d0701020-e66a-4a52-9f98-c266f8bea8db {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:54 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:54 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 Apr 09 16:52:54 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48b208c-ab5e-42d2-9186-d6d08432d310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffea3e7-1923-4e08-a1c6-083218323eb9', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25073de-807e-4819-a16f-a43b85f46ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:54 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Volume volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 (9ffea3e7-1923-4e08-a1c6-083218323eb9): created successfully Apr 09 16:52:54 devstack sudo[84951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db 1073741824 Apr 09 16:52:54 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25073de-807e-4819-a16f-a43b85f46ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Flow 'volume_create_manager' (2d1754de-8961-4fa9-96ba-f9e08805a481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4c88dcc8-3c71-44ee-8b32-688686501089 tempest-ServersNegativeTestJSON-915994705 None] Created volume successfully. Apr 09 16:52:55 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" returned: 0 in 0.759s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:55 devstack sudo[84960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e Apr 09 16:52:55 devstack sudo[84960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:55 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db 1073741824" returned: 0 in 0.736s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:55 devstack sudo[84962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db Apr 09 16:52:55 devstack sudo[84962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:56 devstack sudo[84962]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db" returned: 0 in 0.670s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:56 devstack sudo[84960]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a998d278-a53f-4ee2-90c2-6207ecc1540f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0701020-e66a-4a52-9f98-c266f8bea8db', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1019190-fee3-4281-9a29-2eefd44e3d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e" returned: 0 in 0.783s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:56 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Volume volume-d0701020-e66a-4a52-9f98-c266f8bea8db (d0701020-e66a-4a52-9f98-c266f8bea8db): created successfully Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1019190-fee3-4281-9a29-2eefd44e3d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Flow 'volume_create_manager' (ad9e5d68-5462-48e3-b449-64e38cd0765e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:56 devstack sudo[84968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e Apr 09 16:52:56 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:56 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4965fd50-7074-4584-aa93-9a6bd0ea6d49 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Created volume successfully. Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Flow 'volume_create_manager' (46ea4b78-4ed6-4492-b8db-100fccbc52a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a25a09c-29f2-493c-955c-aa1106f4a47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a25a09c-29f2-493c-955c-aa1106f4a47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2048691860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d599ac8b-c674-4410-b65e-710b000820de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33133bc73d3e4b10a259963d233ef084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:57Z,use_quota=True,user_id='e280cd0f1609420f8bffaca5bc3e39c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e9be88-7c46-4c81-bf49-7bc62417e863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e9be88-7c46-4c81-bf49-7bc62417e863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8b10ae-ce98-4312-a29c-bd7a30d16909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8b10ae-ce98-4312-a29c-bd7a30d16909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd599ac8b-c674-4410-b65e-710b000820de', 'volume_name': 'volume-d599ac8b-c674-4410-b65e-710b000820de', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e068a9cc-b6c2-4974-ab7f-6ed8dd70d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e068a9cc-b6c2-4974-ab7f-6ed8dd70d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4802b8eb-7fb1-4617-a36e-d4c7b9d53992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:56 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Volume d599ac8b-c674-4410-b65e-710b000820de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d599ac8b-c674-4410-b65e-710b000820de', 'volume_size': 1} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2048691860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d599ac8b-c674-4410-b65e-710b000820de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33133bc73d3e4b10a259963d233ef084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:52:57Z,use_quota=True,user_id='e280cd0f1609420f8bffaca5bc3e39c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Creating volume d599ac8b-c674-4410-b65e-710b000820de {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:52:56 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:56 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de 1073741824 Apr 09 16:52:56 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:56 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666.3f3d4984-7551-4d71-9f8f-6d96f18d2f1e" returned: 0 in 0.546s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-3f3d4984-7551-4d71-9f8f-6d96f18d2f1e" released by "_delete_snapshot" :: held 2.887s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" released by "delete_snapshot" :: held 2.915s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-7c0709c8-f52a-4f53-8540-cafeed25dba2" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-7c0709c8-f52a-4f53-8540-cafeed25dba2" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-71721246-4630-4800-972a-0e516cd794ec" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-71721246-4630-4800-972a-0e516cd794ec" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Deleting offline snapshot 71721246-4630-4800-972a-0e516cd794ec of volume 7c0709c8-f52a-4f53-8540-cafeed25dba2 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] snapshot_file for this snap is: volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[23990241-962d-4cfa-96be-4ba3e47d7bdc]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:57 devstack sudo[84973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec Apr 09 16:52:57 devstack sudo[84973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:57 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de 1073741824" returned: 0 in 0.702s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:57 devstack sudo[84982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de Apr 09 16:52:57 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:52:57 devstack sudo[84973]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec" returned: 0 in 0.648s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0709c8-f52a-4f53-8540-cafeed25dba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[824a548d-20a6-442f-9f8a-6d0308043cce]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:57 devstack sudo[84987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 Apr 09 16:52:57 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:57 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de" returned: 0 in 0.485s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.447s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Creating offline snapshot b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 of volume d0701020-e66a-4a52-9f98-c266f8bea8db {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4802b8eb-7fb1-4617-a36e-d4c7b9d53992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d599ac8b-c674-4410-b65e-710b000820de', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d52f46-a546-4694-9a95-514d8184f20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[718ae925-b143-4363-ac53-79eb8df93ca6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:57 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Volume volume-d599ac8b-c674-4410-b65e-710b000820de (d599ac8b-c674-4410-b65e-710b000820de): created successfully Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d52f46-a546-4694-9a95-514d8184f20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:52:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Flow 'volume_create_manager' (46ea4b78-4ed6-4492-b8db-100fccbc52a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:52:57 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2e15316b-a19c-4ef4-9f3f-3bf88c040237 tempest-ServersNegativeTestJSON-915994705 None] Created volume successfully. Apr 09 16:52:58 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db Apr 09 16:52:58 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:58 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2" returned: 0 in 0.522s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:58 devstack sudo[84997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec Apr 09 16:52:58 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:58 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db" returned: 0 in 0.535s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:58 devstack sudo[85003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 1G Apr 09 16:52:58 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:58 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec" returned: 0 in 0.513s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:58 devstack sudo[85008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec Apr 09 16:52:58 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "cinder-d599ac8b-c674-4410-b65e-710b000820de-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Lock "cinder-d599ac8b-c674-4410-b65e-710b000820de-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:59 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 1G" returned: 0 in 0.626s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0701020-e66a-4a52-9f98-c266f8bea8db -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "cinder-quobyte-d599ac8b-c674-4410-b65e-710b000820de" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:52:59 devstack sudo[85013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0701020-e66a-4a52-9f98-c266f8bea8db -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 Apr 09 16:52:59 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Lock "cinder-quobyte-d599ac8b-c674-4410-b65e-710b000820de" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d041a18d-46d1-4209-8ad2-44382a983638]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:59 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2.71721246-4630-4800-972a-0e516cd794ec" returned: 0 in 0.521s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:59 devstack sudo[85016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de Apr 09 16:52:59 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-71721246-4630-4800-972a-0e516cd794ec" released by "_delete_snapshot" :: held 2.301s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-7c0709c8-f52a-4f53-8540-cafeed25dba2" released by "delete_snapshot" :: held 2.325s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:52:59 devstack cinder-volume[82139]: WARNING cinder.quota [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-573789922 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-573789922, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:59 devstack cinder-volume[82139]: WARNING cinder.quota [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-573789922 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-573789922, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Created reservations ['6ee49bc6-e93c-4d26-a110-f865b70f3924', '4c89298a-a0f2-432d-aa57-b92ab578bfce', 'a68b96e4-5203-4992-b98b-e531f7f9d22e', '395d10bd-9d80-4609-a387-1e5472de9c53'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] Created reservations ['462f3051-e3d0-4a68-a05d-3279ddf4de9b', 'b849f1e1-4ed5-4bf2-9d0f-225993793131', 'f2406481-26ef-41c8-8362-b6a73e50a4d6', 'a4d6210b-ea78-4c52-b495-6349e0cf3a75'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:52:59 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a882d541-614c-42d0-a6ff-74d047d33765 tempest-GroupSnapshotsTest-262244781 None] group_snapshot c60fb4c6-643f-43a5-a96d-1a70edabf620: deleted successfully Apr 09 16:52:59 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0701020-e66a-4a52-9f98-c266f8bea8db -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3" returned: 0 in 0.568s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:59 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 is being set with open permissions: ugo+rw Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:59 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de" returned: 0 in 0.544s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:52:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:52:59 devstack sudo[85024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 Apr 09 16:52:59 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:52:59 devstack sudo[85026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de Apr 09 16:52:59 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:00 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3" returned: 0 in 0.464s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:00 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d599ac8b-c674-4410-b65e-710b000820de" returned: 0 in 0.453s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Lock "cinder-quobyte-d599ac8b-c674-4410-b65e-710b000820de" released by "delete_volume" :: held 1.030s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:00 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.info Apr 09 16:53:00 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Created reservations ['82d1b612-4f26-4792-9156-182feb7c6430', '40666eaf-eb7b-40ef-ae11-7d1bd79ac7ee', 'e3f39803-2fcd-4403-b8e1-1613223e7dfd', '569626ad-90b3-493f-8b0f-45ba880411cd'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:00 devstack sudo[85032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:00 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:00 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.info" returned: 0 in 0.597s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:00 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.info is being set with open permissions: ugo+rw Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:00 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:00 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.info Apr 09 16:53:00 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.573s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:00 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Deleted volume successfully. Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-7c0709c8-f52a-4f53-8540-cafeed25dba2" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-777e15e9-3a2b-42ef-8381-d64e8ad25959 tempest-ServersNegativeTestJSON-915994705 None] Lock "cinder-d599ac8b-c674-4410-b65e-710b000820de-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-7c0709c8-f52a-4f53-8540-cafeed25dba2" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e274ae31-2417-4973-9358-67af95f009d6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:01 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 Apr 09 16:53:01 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "cinder-9ffea3e7-1923-4e08-a1c6-083218323eb9-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Lock "cinder-9ffea3e7-1923-4e08-a1c6-083218323eb9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:01 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "cinder-quobyte-9ffea3e7-1923-4e08-a1c6-083218323eb9" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.info" returned: 0 in 0.676s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.585s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Lock "cinder-quobyte-9ffea3e7-1923-4e08-a1c6-083218323eb9" acquired by "delete_volume" :: waited 0.038s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0f1c8d-8942-4277-bda5-3fcf5fae50e7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:01 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e08c0a1e-7954-462d-aee3-44b86543aed2 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Create snapshot completed successfully Apr 09 16:53:01 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2" returned: 0 in 0.702s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:01 devstack sudo[85044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 Apr 09 16:53:01 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:01 devstack sudo[85045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2 Apr 09 16:53:01 devstack sudo[85045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "cinder-b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "cinder-quobyte-d0701020-e66a-4a52-9f98-c266f8bea8db" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-quobyte-d0701020-e66a-4a52-9f98-c266f8bea8db" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "cinder-quobyte-b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-quobyte-b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Deleting offline snapshot b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 of volume d0701020-e66a-4a52-9f98-c266f8bea8db {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] snapshot_file for this snap is: volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f501fc98-beae-4dec-8698-69a3828e52bc]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:02 devstack sudo[85049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 Apr 09 16:53:02 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:02 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9" returned: 0 in 1.029s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:02 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9 Apr 09 16:53:02 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:02 devstack sudo[85045]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c0709c8-f52a-4f53-8540-cafeed25dba2" returned: 0 in 0.986s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-7c0709c8-f52a-4f53-8540-cafeed25dba2" released by "delete_volume" :: held 1.766s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ad413c-521d-4542-9fdc-ce9e13e31af0]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:02 devstack sudo[85057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 Apr 09 16:53:02 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:03 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9ffea3e7-1923-4e08-a1c6-083218323eb9" returned: 0 in 0.820s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Lock "cinder-quobyte-9ffea3e7-1923-4e08-a1c6-083218323eb9" released by "delete_volume" :: held 1.936s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:03 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3" returned: 0 in 1.091s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0701020-e66a-4a52-9f98-c266f8bea8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f1159b-ad56-4d3f-83fd-efeaa0acc3a5]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Created reservations ['ef51c33a-1f7f-4e08-8d95-67ce60d650fb', '88b7640a-be29-4a1f-8cdc-47cfca75c1fc', '6b080853-dfed-40fc-b06d-0522efabfec6', 'ae231401-c760-4a19-9fff-696ec28bac27'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:03 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:03 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:03 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db Apr 09 16:53:03 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:03 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" returned: 0 in 1.228s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:04 devstack sudo[85072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666 Apr 09 16:53:04 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Flow 'volume_create_manager' (edd70da3-0e0c-46d5-86ae-f1025e44fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05772efc-dd87-4380-8e96-24fb39b79e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05772efc-dd87-4380-8e96-24fb39b79e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a552f8-28aa-43e6-8ca7-ae3a26bee291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30442f5ced7e43a4bb5f3a4f6564c372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:04Z,use_quota=True,user_id='cb5a20c682114d8e8b08f13c6fc7d120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c86992-1eec-46ec-9871-32835f325927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c86992-1eec-46ec-9871-32835f325927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15041207-9c0f-45f6-afcb-252b1390ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.image.glance [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Creating Keystone auth plugin from conf {{(pid=82139) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 16:53:04 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.975s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:04 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Deleted volume successfully. Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-33d2afb3-82be-4ed3-a20d-d49f35c8fecc tempest-ServersNegativeTestJSON-915994705 None] Lock "cinder-9ffea3e7-1923-4e08-a1c6-083218323eb9-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:04 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db" returned: 0 in 1.299s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15041207-9c0f-45f6-afcb-252b1390ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51a552f8-28aa-43e6-8ca7-ae3a26bee291', 'volume_name': 'volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e50c5ef-7bbf-4f62-b742-caa7e645ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:04 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e50c5ef-7bbf-4f62-b742-caa7e645ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ad8a8c-6c01-4316-886d-5c68deb2ee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:04 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:04 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Volume 51a552f8-28aa-43e6-8ca7-ae3a26bee291: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Trying to clone 51a552f8-28aa-43e6-8ca7-ae3a26bee291 from image d01216e8-c5dc-4c96-8184-f8935064d568 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]). {{(pid=82139) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 16:53:04 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" returned: 0 in 1.000s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-cc69ddf9-3188-4b8c-97ea-d6cce7e69666" released by "delete_volume" :: held 2.281s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Created reservations ['dbb2a219-a238-48e3-bece-af7aa6baf0f4'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 16:53:05 devstack cinder-volume[82139]: INFO cinder.image.image_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Image download 20.69 MB at 20.69 MB/s Apr 09 16:53:05 devstack cinder-volume[82139]: WARNING cinder.quota [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-573789922 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-573789922, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Created reservations ['6914e2e1-c148-4a11-91b0-e36afec2a6ff', '6fa97a9d-16e4-4712-9f3a-ab1980afae32', '4a8216ce-5d66-4344-b7a6-a37f7b0d65e3', 'e885b53c-b37d-4161-a2d8-63b6a4a98f14'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479cbe5-832a-48ee-ad23-219d3b27377e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:05 devstack sudo[85109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD Apr 09 16:53:05 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Created reservations ['2eae58f4-bd72-4a17-a4bf-fbcf7c0f1a5c', 'df502aff-fa99-4a7d-b22e-efae494ea6eb', '35316a53-55b9-4653-a68c-dfe2f12d22b4', '9c1730f6-c011-4c5b-bb02-24d8a80122c1'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:05 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3" returned: 0 in 0.672s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:05 devstack sudo[85134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3 Apr 09 16:53:05 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:05 devstack sudo[85136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:05 devstack sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-88ae2247-a87a-494e-bf6f-8b41be26f8b3 tempest-GroupSnapshotsTest-262244781 None] Group tempest-GroupSnapshotsTest-Group-63748348: creating Apr 09 16:53:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-88ae2247-a87a-494e-bf6f-8b41be26f8b3 tempest-GroupSnapshotsTest-262244781 None] Group tempest-GroupSnapshotsTest-Group-63748348: created successfully Apr 09 16:53:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-88ae2247-a87a-494e-bf6f-8b41be26f8b3 tempest-GroupSnapshotsTest-262244781 None] Create group completed successfully. Apr 09 16:53:06 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD" returned: 0 in 1.283s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Temporary image d01216e8-c5dc-4c96-8184-f8935064d568 is fetched for user cb5a20c682114d8e8b08f13c6fc7d120. {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[6408a7ae-d14c-4e55-a73c-fc90f9901089]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:06 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db.b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3" returned: 0 in 1.152s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-quobyte-b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3" released by "_delete_snapshot" :: held 4.355s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-quobyte-d0701020-e66a-4a52-9f98-c266f8bea8db" released by "delete_snapshot" :: held 4.378s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:06 devstack cinder-volume[82139]: WARNING cinder.quota [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:06 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Created reservations ['aa27302d-6a0d-48d0-9398-412e01750da3', 'c63682a2-aa2c-4167-98aa-487b764685f0', 'd2264af7-2e2f-46e3-ba89-239e07ebdc01', 'ea56c78a-ed18-449d-8eb5-7c38904cc7af'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:06 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Delete snapshot completed successfully. Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-231bd2fb-cef5-4b65-888e-360c5ed40b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-b542607c-4c2b-4ed4-9f2a-ef3e636a4fd3-delete_snapshot" released by "delete_snapshot" :: held 4.536s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:06 devstack sudo[85136]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 1.239s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:06 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d5a40a95-1c38-4381-9e3d-4133596feb8b tempest-GroupSnapshotsTest-262244781 None] Delete group completed successfully. Apr 09 16:53:07 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD" returned: 0 in 0.737s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a552f8-28aa-43e6-8ca7-ae3a26bee291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30442f5ced7e43a4bb5f3a4f6564c372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:04Z,use_quota=True,user_id='cb5a20c682114d8e8b08f13c6fc7d120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Creating volume 51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:53:07 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:07 devstack sudo[85152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 1073741824 Apr 09 16:53:07 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Flow 'volume_create_manager' (25a4eb16-cae4-41f8-ab3e-3e6c59038688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963e1b64-4f71-47b9-83f1-9d8ac9ae9098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "cinder-d0701020-e66a-4a52-9f98-c266f8bea8db-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963e1b64-4f71-47b9-83f1-9d8ac9ae9098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-970722899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df866309-a31c-4c58-b41e-bd8016fe2cf5,host='devstack@QuobyteHD#QuobyteHD',id=594ee2c4-58f6-4849-acf9-79a192e07f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ed27045d064ac59c877ce342979051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:08Z,use_quota=True,user_id='88989af34a5f4358a00c44273b97ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fb19f9d-627f-4aa5-b462-c558af9784f1),volume_type_id=0fb19f9d-627f-4aa5-b462-c558af9784f1)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d3f0e8-1adc-48d9-a285-77b4361fed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d3f0e8-1adc-48d9-a285-77b4361fed76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfaa453e-d286-4b8a-b2fa-88869a29cb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfaa453e-d286-4b8a-b2fa-88869a29cb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594ee2c4-58f6-4849-acf9-79a192e07f79', 'volume_name': 'volume-594ee2c4-58f6-4849-acf9-79a192e07f79', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cb87a3-5ed6-493b-8cbf-2f34f774102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cb87a3-5ed6-493b-8cbf-2f34f774102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a620712b-cce5-411e-8d4a-298d014656ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:07 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Volume 594ee2c4-58f6-4849-acf9-79a192e07f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594ee2c4-58f6-4849-acf9-79a192e07f79', 'volume_size': 1} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-d0701020-e66a-4a52-9f98-c266f8bea8db-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "cinder-quobyte-d0701020-e66a-4a52-9f98-c266f8bea8db" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-quobyte-d0701020-e66a-4a52-9f98-c266f8bea8db" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[717dea46-332e-48f6-af6d-f9d7dcbfc30c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:07 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db Apr 09 16:53:07 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:08 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 1073741824" returned: 0 in 0.694s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:08 devstack sudo[85160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:08 devstack sudo[85160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:08 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db" returned: 0 in 0.551s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:08 devstack sudo[85166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db Apr 09 16:53:08 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:08 devstack sudo[85160]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 0 in 0.453s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df866309-a31c-4c58-b41e-bd8016fe2cf5,created_at=2026-04-09T14:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-970722899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df866309-a31c-4c58-b41e-bd8016fe2cf5,host='devstack@QuobyteHD#QuobyteHD',id=594ee2c4-58f6-4849-acf9-79a192e07f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ed27045d064ac59c877ce342979051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:08Z,use_quota=True,user_id='88989af34a5f4358a00c44273b97ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fb19f9d-627f-4aa5-b462-c558af9784f1),volume_type_id=0fb19f9d-627f-4aa5-b462-c558af9784f1)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Creating volume 594ee2c4-58f6-4849-acf9-79a192e07f79 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:53:08 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:08 devstack sudo[85169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 1073741824 Apr 09 16:53:08 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Attempting download of d01216e8-c5dc-4c96-8184-f8935064d568 ((None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}])) to volume 51a552f8-28aa-43e6-8ca7-ae3a26bee291. {{(pid=82139) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5009e35d-370f-46ca-8035-fd0ce79539c3]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_5ewpwe68 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:08 devstack sudo[85171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_5ewpwe68 Apr 09 16:53:08 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:08 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d0701020-e66a-4a52-9f98-c266f8bea8db" returned: 0 in 0.498s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-quobyte-d0701020-e66a-4a52-9f98-c266f8bea8db" released by "delete_volume" :: held 1.093s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Created reservations ['4dace7cc-e2b1-4e2b-9238-6aa561851ed6', 'cd22fa96-2161-492b-a3ac-4bc4efa9e0eb', '3c853feb-fba1-4550-bc5d-32d35df8f5f5', 'b2fd6ef8-14c5-4617-b395-897843173d95'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:09 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:09 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:09 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 1073741824" returned: 0 in 0.800s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:09 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_5ewpwe68" returned: 0 in 0.738s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_5ewpwe68 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:09 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 Apr 09 16:53:09 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:09 devstack sudo[85182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_5ewpwe68 Apr 09 16:53:09 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:09 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.478s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:09 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Deleted volume successfully. Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6fa8cfac-6754-4159-996e-25c6dc81c20a tempest-VolumeSnapshotQuotasNegativeTestJSON-668686675 None] Lock "cinder-d0701020-e66a-4a52-9f98-c266f8bea8db-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:09 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79" returned: 0 in 0.445s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a620712b-cce5-411e-8d4a-298d014656ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594ee2c4-58f6-4849-acf9-79a192e07f79', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dabeec-f933-4b0c-beee-a27cfe3abb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:09 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_5ewpwe68" returned: 1 in 0.485s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_5ewpwe68' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:53:09 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Volume volume-594ee2c4-58f6-4849-acf9-79a192e07f79 (594ee2c4-58f6-4849-acf9-79a192e07f79): created successfully Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dabeec-f933-4b0c-beee-a27cfe3abb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Flow 'volume_create_manager' (25a4eb16-cae4-41f8-ab3e-3e6c59038688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f067667-15f9-40bc-8523-b6f0ab63df4e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:09 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c7698d31-5319-4726-a6e1-78bc7da4fd32 tempest-GroupSnapshotsTest-262244781 None] Created volume successfully. Apr 09 16:53:10 devstack sudo[85195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD Apr 09 16:53:10 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:10 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD" returned: 0 in 0.608s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:10 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] d01216e8-c5dc-4c96-8184-f8935064d568 was qcow2, converting to raw {{(pid=82139) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 16:53:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:10 devstack sudo[85200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:10 devstack sudo[85200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:11 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] GroupSnapshot a1873fbf-fa8d-42e4-b202-53ab361110e0: creating. Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Group snapshot a1873fbf-fa8d-42e4-b202-53ab361110e0: creating. {{(pid=82139) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Creating offline snapshot 41de93cc-5e89-4210-8327-ce2d71f77e65 of volume 594ee2c4-58f6-4849-acf9-79a192e07f79 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e11786-02fe-4a55-a353-573820f77117]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:11 devstack sudo[85235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 Apr 09 16:53:11 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:11 devstack sudo[85200]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 0 in 1.200s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_7xm96tf1devstack@QuobyteHD, size 112.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:53:11 devstack cinder-volume[82139]: INFO cinder.image.image_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Converted 112.00 MB image at 93.22 MB/s Apr 09 16:53:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:11 devstack sudo[85237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 1G Apr 09 16:53:11 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:12 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79" returned: 0 in 0.805s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:12 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 1G Apr 09 16:53:12 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:12 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 1G" returned: 0 in 0.715s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:12 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea15c3c4-5173-46f6-9bb3-68e36d8e8827]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:12 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:12 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:13 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 1G" returned: 0 in 0.952s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-594ee2c4-58f6-4849-acf9-79a192e07f79 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:13 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-594ee2c4-58f6-4849-acf9-79a192e07f79 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 Apr 09 16:53:13 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:13 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 0 in 0.756s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:13 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:13 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:13 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-594ee2c4-58f6-4849-acf9-79a192e07f79 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65" returned: 0 in 0.727s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:13 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:53:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:13 devstack sudo[85262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 Apr 09 16:53:13 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:14 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 1 in 0.858s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Downloaded image d01216e8-c5dc-4c96-8184-f8935064d568 ((None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}])) to volume 51a552f8-28aa-43e6-8ca7-ae3a26bee291 successfully. {{(pid=82139) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Temporary image d01216e8-c5dc-4c96-8184-f8935064d568 for user cb5a20c682114d8e8b08f13c6fc7d120 is deleted. {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Marking volume 51a552f8-28aa-43e6-8ca7-ae3a26bee291 as bootable. {{(pid=82139) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 16:53:14 devstack sudo[85267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:14 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Copying metadata from image d01216e8-c5dc-4c96-8184-f8935064d568 to 51a552f8-28aa-43e6-8ca7-ae3a26bee291. {{(pid=82139) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Creating volume glance metadata for volume 51a552f8-28aa-43e6-8ca7-ae3a26bee291 backed by image d01216e8-c5dc-4c96-8184-f8935064d568 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82139) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ad8a8c-6c01-4316-886d-5c68deb2ee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be93dbb-ddf9-4e1c-b6b9-6702484e25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:14 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Volume volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 (51a552f8-28aa-43e6-8ca7-ae3a26bee291): created successfully Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be93dbb-ddf9-4e1c-b6b9-6702484e25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Flow 'volume_create_manager' (edd70da3-0e0c-46d5-86ae-f1025e44fca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-8687db83-523a-45fe-b464-004d79e839af tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Created volume successfully. Apr 09 16:53:14 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65" returned: 0 in 0.806s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:14 devstack sudo[85270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.info Apr 09 16:53:14 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:15 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.931s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Flow 'volume_create_manager' (3d6092e8-1f5a-4723-90f8-c9541883bb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5fa13f-9140-413b-9d51-ed119d0e0ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5fa13f-9140-413b-9d51-ed119d0e0ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-200945496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a881bee4-92d8-43fc-a719-af1e636c8f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7b4b66412640b19f913355d5d8d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:15Z,use_quota=True,user_id='cb9dcec259444166ac41a02366bc7011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(310b1ee8-81a4-4a45-a14f-a440d0b7beed),volume_type_id=310b1ee8-81a4-4a45-a14f-a440d0b7beed)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b1ee90-47a3-49f7-83f7-ddf8e07f305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b1ee90-47a3-49f7-83f7-ddf8e07f305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbd7cb7-86f0-46ed-bedb-ee846498a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbd7cb7-86f0-46ed-bedb-ee846498a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a881bee4-92d8-43fc-a719-af1e636c8f31', 'volume_name': 'volume-a881bee4-92d8-43fc-a719-af1e636c8f31', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c72bb5a-a261-4400-b42d-a9adb116c5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c72bb5a-a261-4400-b42d-a9adb116c5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b269435-1861-4edb-ae83-d93363a826b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:15 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Volume a881bee4-92d8-43fc-a719-af1e636c8f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a881bee4-92d8-43fc-a719-af1e636c8f31', 'volume_size': 1} Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:15 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.info" returned: 0 in 0.838s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:15 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:53:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:15 devstack sudo[85275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.info Apr 09 16:53:15 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:16 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.info" returned: 0 in 0.492s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.695s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-200945496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a881bee4-92d8-43fc-a719-af1e636c8f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7b4b66412640b19f913355d5d8d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:15Z,use_quota=True,user_id='cb9dcec259444166ac41a02366bc7011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(310b1ee8-81a4-4a45-a14f-a440d0b7beed),volume_type_id=310b1ee8-81a4-4a45-a14f-a440d0b7beed)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Creating volume a881bee4-92d8-43fc-a719-af1e636c8f31 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:53:16 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:16 devstack sudo[85278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 1073741824 Apr 09 16:53:16 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3bd8e46a-6ead-41f3-a26a-955ee758bfc3 tempest-GroupSnapshotsTest-262244781 None] group_snapshot a1873fbf-fa8d-42e4-b202-53ab361110e0: created successfully Apr 09 16:53:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] group_snapshot a1873fbf-fa8d-42e4-b202-53ab361110e0: deleting Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] group_snapshot a1873fbf-fa8d-42e4-b202-53ab361110e0: deleting {{(pid=82139) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-594ee2c4-58f6-4849-acf9-79a192e07f79" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-594ee2c4-58f6-4849-acf9-79a192e07f79" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-41de93cc-5e89-4210-8327-ce2d71f77e65" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-41de93cc-5e89-4210-8327-ce2d71f77e65" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Deleting offline snapshot 41de93cc-5e89-4210-8327-ce2d71f77e65 of volume 594ee2c4-58f6-4849-acf9-79a192e07f79 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:53:16 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] snapshot_file for this snap is: volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 1073741824" returned: 0 in 0.854s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=163,cinder:UPDATE=176,cinder:INSERT=40,cinder:DELETE=5 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c081f57-3a98-412f-82cf-e19cb481bc9b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:17 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 Apr 09 16:53:17 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:17 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 Apr 09 16:53:17 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:17 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65" returned: 0 in 0.651s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-594ee2c4-58f6-4849-acf9-79a192e07f79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b88794-6855-4632-aca9-fcaa00f4ce97]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=163,cinder:SELECT=175,cinder:DELETE=9,cinder:INSERT=50 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:53:17 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:53:17 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 Apr 09 16:53:17 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Flow 'volume_create_manager' (53f5d8e4-b8cd-46b7-b041-babe7c3a99c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbee3bd-d241-4b94-8f13-9d2861832c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31" returned: 0 in 0.770s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.669s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbee3bd-d241-4b94-8f13-9d2861832c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-175233359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8f0838-e139-4000-b256-ba57630803f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77398cecf44a5484f7341fb4c832d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:18Z,use_quota=True,user_id='5075adf340e0494eb33e69a9c0e00c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c6f1bf-d632-4fb0-aea8-518d3c07e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c6f1bf-d632-4fb0-aea8-518d3c07e57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51da9e6a-c84d-46f2-a844-dfca28e9ea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51da9e6a-c84d-46f2-a844-dfca28e9ea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8f0838-e139-4000-b256-ba57630803f9', 'volume_name': 'volume-9f8f0838-e139-4000-b256-ba57630803f9', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed651fe5-08f8-41a7-909f-083898e57cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed651fe5-08f8-41a7-909f-083898e57cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c88d751-f6d6-4e6b-a5c7-78b543234362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:17 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Volume 9f8f0838-e139-4000-b256-ba57630803f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8f0838-e139-4000-b256-ba57630803f9', 'volume_size': 1} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a98d0df-5a3c-4bd3-b146-364660640318]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b269435-1861-4edb-ae83-d93363a826b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a881bee4-92d8-43fc-a719-af1e636c8f31', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b7f278-09e2-469e-9561-b65b8bf1fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:17 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Volume volume-a881bee4-92d8-43fc-a719-af1e636c8f31 (a881bee4-92d8-43fc-a719-af1e636c8f31): created successfully Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b7f278-09e2-469e-9561-b65b8bf1fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Flow 'volume_create_manager' (3d6092e8-1f5a-4723-90f8-c9541883bb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:17 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3216b843-82b6-40dc-a67e-8ecaf1d70dea tempest-VolumeTypesAccessTest-47577485 None] Created volume successfully. Apr 09 16:53:17 devstack sudo[85301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:17 devstack sudo[85301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:18 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79" returned: 0 in 0.541s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:18 devstack sudo[85306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 Apr 09 16:53:18 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:18 devstack sudo[85301]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:18 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:18 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:18 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65" returned: 0 in 0.590s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:18 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65 Apr 09 16:53:18 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Acquiring lock "cinder-a881bee4-92d8-43fc-a719-af1e636c8f31-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Lock "cinder-a881bee4-92d8-43fc-a719-af1e636c8f31-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Acquiring lock "cinder-quobyte-a881bee4-92d8-43fc-a719-af1e636c8f31" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Lock "cinder-quobyte-a881bee4-92d8-43fc-a719-af1e636c8f31" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:18 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b634aa9f-a0d4-456b-bcec-a4b92bfe5b34]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 1 in 0.574s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.145s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-175233359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8f0838-e139-4000-b256-ba57630803f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a77398cecf44a5484f7341fb4c832d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:18Z,use_quota=True,user_id='5075adf340e0494eb33e69a9c0e00c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Creating volume 9f8f0838-e139-4000-b256-ba57630803f9 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:53:18 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:18 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 1073741824 Apr 09 16:53:18 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784', 'name': 'volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2a7e7a9-f709-43be-a9b6-bc467b325fd9', 'enforce_multipath': True} {{(pid=82139) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 16:53:19 devstack sudo[85321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 Apr 09 16:53:19 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:19 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-d12d95f7-30d5-4139-8981-5c73dfb0ef5c req-a992ba23-dfb7-442e-b47b-8022e7b16618 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] attachment_update completed successfully. Apr 09 16:53:19 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79.41de93cc-5e89-4210-8327-ce2d71f77e65" returned: 0 in 0.522s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-41de93cc-5e89-4210-8327-ce2d71f77e65" released by "_delete_snapshot" :: held 2.393s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-594ee2c4-58f6-4849-acf9-79a192e07f79" released by "delete_snapshot" :: held 2.408s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:19 devstack cinder-volume[82139]: WARNING cinder.quota [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1316713728 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1316713728, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:19 devstack cinder-volume[82139]: WARNING cinder.quota [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1316713728 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1316713728, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] Created reservations ['46953016-d4e0-47a4-a2ff-19f55c5b2b21', 'e24b0e61-ad5d-48f6-9510-333d95fef121', '680191b3-1f9d-48bb-becb-994c7cff7dd0', 'af07e58f-8f43-427b-bc6e-a8a2d77d4a6c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:19 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-402f5280-4d62-4b03-8bdb-720d4fbbd452 tempest-GroupSnapshotsTest-262244781 None] group_snapshot a1873fbf-fa8d-42e4-b202-53ab361110e0: deleted successfully Apr 09 16:53:19 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31" returned: 0 in 0.587s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:19 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31 Apr 09 16:53:19 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:19 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 1073741824" returned: 0 in 0.619s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:19 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 Apr 09 16:53:19 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:19 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a881bee4-92d8-43fc-a719-af1e636c8f31" returned: 0 in 0.424s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Lock "cinder-quobyte-a881bee4-92d8-43fc-a719-af1e636c8f31" released by "delete_volume" :: held 1.062s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:19 devstack cinder-volume[82139]: WARNING cinder.quota [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-243473175 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-243473175, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:19 devstack cinder-volume[82139]: WARNING cinder.quota [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-243473175 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-243473175, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:19 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Created reservations ['74566690-836b-49c8-9144-469d8d93a750', '4221d56c-98c5-419d-972f-5658a6db30da', '0ac68f18-4ea4-451e-937e-f913df6d01c0', '1fba4f40-846c-4e4b-be89-63d412147b51'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:20 devstack sudo[85338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:20 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:20 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9" returned: 0 in 0.647s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c88d751-f6d6-4e6b-a5c7-78b543234362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8f0838-e139-4000-b256-ba57630803f9', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1676c522-b9db-4a67-ae88-f495696c5f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:20 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Volume volume-9f8f0838-e139-4000-b256-ba57630803f9 (9f8f0838-e139-4000-b256-ba57630803f9): created successfully Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1676c522-b9db-4a67-ae88-f495696c5f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Flow 'volume_create_manager' (53f5d8e4-b8cd-46b7-b041-babe7c3a99c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:20 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-2db24afc-e65a-485a-bd29-58860ce48865 req-4399da93-6ac5-4f5c-8519-100ce6a4317b tempest-VolumesSnapshotsTestJSON-33206399 None] Created volume successfully. Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "cinder-quobyte-594ee2c4-58f6-4849-acf9-79a192e07f79" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-594ee2c4-58f6-4849-acf9-79a192e07f79" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c56c30-04f9-4f8b-ba5f-2989d0effaf0]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:20 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 Apr 09 16:53:20 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:20 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.784s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:20 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Deleted volume successfully. Apr 09 16:53:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-84b58b29-56cb-4400-bff9-1f4d03d65e32 tempest-VolumeTypesAccessTest-47577485 None] Lock "cinder-a881bee4-92d8-43fc-a719-af1e636c8f31-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:21 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79" returned: 0 in 0.537s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:21 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79 Apr 09 16:53:21 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Creating offline snapshot 3dc08a7b-a1bc-4105-a9fe-8349489632cf of volume 9f8f0838-e139-4000-b256-ba57630803f9 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a302c6-5a7c-4875-bdb3-57ad2f0f5f56]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:21 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 Apr 09 16:53:21 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:21 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-594ee2c4-58f6-4849-acf9-79a192e07f79" returned: 0 in 0.618s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Lock "cinder-quobyte-594ee2c4-58f6-4849-acf9-79a192e07f79" released by "delete_volume" :: held 1.209s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Created reservations ['401b7d49-b8b5-41de-a206-76120c299f3f'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:21 devstack cinder-volume[82139]: WARNING cinder.quota [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1316713728 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1316713728, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Created reservations ['9abab111-bc40-4980-8d90-868221116b80', '7ec5f78b-c222-4bc6-bcbc-1ccabd619118', '42597448-17ed-4722-9189-1211e01b7d58', '6ea0043f-e0cd-4ab5-8d31-e30781595447'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:21 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:21 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:21 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9" returned: 0 in 0.707s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:22 devstack sudo[85359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf 1G Apr 09 16:53:22 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:22 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.513s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:22 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:22 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-264dfc39-e45c-477a-b985-815b2e7abfdc tempest-GroupSnapshotsTest-262244781 None] Delete group completed successfully. Apr 09 16:53:22 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf 1G" returned: 0 in 0.566s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8f0838-e139-4000-b256-ba57630803f9 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:22 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8f0838-e139-4000-b256-ba57630803f9 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf Apr 09 16:53:22 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:23 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8f0838-e139-4000-b256-ba57630803f9 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf" returned: 0 in 0.613s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:23 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf is being set with open permissions: ugo+rw Apr 09 16:53:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:23 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf Apr 09 16:53:23 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:23 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf" returned: 0 in 0.718s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:23 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.info Apr 09 16:53:23 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:24 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.info" returned: 0 in 0.805s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:24 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.info is being set with open permissions: ugo+rw Apr 09 16:53:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:24 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.info Apr 09 16:53:24 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:25 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.info" returned: 0 in 0.741s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:25 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-ba495860-7a11-4e30-8fa3-220485e90f25 req-a9a6d254-64f2-4c2f-a274-1a59ecaf9987 tempest-VolumesSnapshotsTestJSON-33206399 None] Create snapshot completed successfully Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "cinder-3dc08a7b-a1bc-4105-a9fe-8349489632cf-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-3dc08a7b-a1bc-4105-a9fe-8349489632cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "cinder-quobyte-9f8f0838-e139-4000-b256-ba57630803f9" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-quobyte-9f8f0838-e139-4000-b256-ba57630803f9" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "cinder-quobyte-3dc08a7b-a1bc-4105-a9fe-8349489632cf" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-quobyte-3dc08a7b-a1bc-4105-a9fe-8349489632cf" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Deleting offline snapshot 3dc08a7b-a1bc-4105-a9fe-8349489632cf of volume 9f8f0838-e139-4000-b256-ba57630803f9 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] snapshot_file for this snap is: volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a6bfb8-ea92-4e66-94d6-53191a26bc0a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:26 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf Apr 09 16:53:26 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:27 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf" returned: 0 in 0.953s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f8f0838-e139-4000-b256-ba57630803f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:27 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc271af6-ee22-49de-a0ce-2433f2407ca0]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:27 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 Apr 09 16:53:27 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:27 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9" returned: 0 in 0.693s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:27 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf Apr 09 16:53:27 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:28 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf" returned: 0 in 0.964s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:28 devstack sudo[85424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf Apr 09 16:53:28 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:29 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9.3dc08a7b-a1bc-4105-a9fe-8349489632cf" returned: 0 in 0.511s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-quobyte-3dc08a7b-a1bc-4105-a9fe-8349489632cf" released by "_delete_snapshot" :: held 3.288s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-quobyte-9f8f0838-e139-4000-b256-ba57630803f9" released by "delete_snapshot" :: held 3.361s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:29 devstack cinder-volume[82139]: DEBUG cinder.quota [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Created reservations ['4280e4e4-c4ad-4d5b-ae08-4e2abad17cce', 'c11c0658-4b01-448e-8f1b-50b35f3f9cef', 'd9362a54-1cbf-4a2c-aff2-6102ef17b7e9', 'caee20d1-afa9-4bfb-9cda-12146aca7b92'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Delete snapshot completed successfully. Apr 09 16:53:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-40d033a1-fbaa-442a-bdaf-d1226e4cbc93 req-83627002-cb48-4c12-9610-0d6fe25d361a tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-3dc08a7b-a1bc-4105-a9fe-8349489632cf-delete_snapshot" released by "delete_snapshot" :: held 3.490s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "cinder-9f8f0838-e139-4000-b256-ba57630803f9-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-9f8f0838-e139-4000-b256-ba57630803f9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "cinder-quobyte-9f8f0838-e139-4000-b256-ba57630803f9" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-quobyte-9f8f0838-e139-4000-b256-ba57630803f9" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:30 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfbe631-dbe8-4670-8e30-4cecb237d64a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:30 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 Apr 09 16:53:30 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:31 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9" returned: 0 in 0.602s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:31 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9 Apr 09 16:53:31 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:31 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-9f8f0838-e139-4000-b256-ba57630803f9" returned: 0 in 0.623s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-quobyte-9f8f0838-e139-4000-b256-ba57630803f9" released by "delete_volume" :: held 1.261s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:31 devstack cinder-volume[82139]: DEBUG cinder.quota [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Created reservations ['9eafead2-0a0e-4739-9c51-ae157f4438b5', 'edf60289-a4d9-4f33-a84f-47997fc8b3df', '311e3e9f-e19e-4257-beb9-3063c5f92e35', '6f37b2a3-069b-4bb3-b5fb-3cdc0c74624e'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:32 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:32 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Flow 'volume_create_manager' (177948cf-1f92-4e88-a5f5-d14708e0c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00384704-9e55-4597-9e67-59ede15a41b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00384704-9e55-4597-9e67-59ede15a41b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1621865955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3eace4b-ab82-4b00-a2e9-56cbca06055f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917060d78b2a4ee9951c55c5c8598691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:33Z,use_quota=True,user_id='adce23dbd7df47219b49f28c54e5c5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:32 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9ad529-1cd9-4ba1-b787-bbc8d7a15cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9ad529-1cd9-4ba1-b787-bbc8d7a15cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de50806-34a8-4596-8ed5-11f05fc165dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de50806-34a8-4596-8ed5-11f05fc165dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3eace4b-ab82-4b00-a2e9-56cbca06055f', 'volume_name': 'volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407a93c5-09e5-4080-ace4-6d87caf33b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407a93c5-09e5-4080-ace4-6d87caf33b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8238e938-a7e0-40f5-bd47-080703d97cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:32 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Volume e3eace4b-ab82-4b00-a2e9-56cbca06055f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f', 'volume_size': 1} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1621865955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3eace4b-ab82-4b00-a2e9-56cbca06055f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917060d78b2a4ee9951c55c5c8598691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:33Z,use_quota=True,user_id='adce23dbd7df47219b49f28c54e5c5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Creating volume e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:53:32 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.639s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.manager [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:32 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Deleted volume successfully. Apr 09 16:53:32 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f 1073741824 Apr 09 16:53:32 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-f3f5eb20-23e0-48d2-9c80-344cd711e943 req-4ca9b59f-7463-4d83-bf1b-4c7520b373bf tempest-VolumesSnapshotsTestJSON-33206399 None] Lock "cinder-9f8f0838-e139-4000-b256-ba57630803f9-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:33 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f 1073741824" returned: 0 in 0.642s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:33 devstack sudo[85493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f Apr 09 16:53:33 devstack sudo[85493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:33 devstack sudo[85493]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f" returned: 0 in 0.501s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8238e938-a7e0-40f5-bd47-080703d97cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb55e943-4bc0-4ed0-b883-909e996eb970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:33 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Volume volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f (e3eace4b-ab82-4b00-a2e9-56cbca06055f): created successfully Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb55e943-4bc0-4ed0-b883-909e996eb970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Flow 'volume_create_manager' (177948cf-1f92-4e88-a5f5-d14708e0c259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3948274c-4cf7-4004-a6ae-dded7fe0f1b1 tempest-VolumesSnapshotListTestJSON-1980145437 None] Created volume successfully. Apr 09 16:53:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Creating offline snapshot f9eb56c9-5c73-4fde-84c5-4bfc19211a2a of volume e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:53:34 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdeb0c1-641f-4430-af26-2f336cb00da2]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:34 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f Apr 09 16:53:34 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:35 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f" returned: 0 in 0.586s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:35 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a 1G Apr 09 16:53:35 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:36 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a 1G" returned: 0 in 0.619s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:36 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a Apr 09 16:53:36 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3a3e5d9f-f377-4932-88e6-a6f3a7cc10d8 tempest-GroupsV314Test-1739850430 None] Group tempest-GroupsV314Test-Group-1064358176: creating Apr 09 16:53:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3a3e5d9f-f377-4932-88e6-a6f3a7cc10d8 tempest-GroupsV314Test-1739850430 None] Group tempest-GroupsV314Test-Group-1064358176: created successfully Apr 09 16:53:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3a3e5d9f-f377-4932-88e6-a6f3a7cc10d8 tempest-GroupsV314Test-1739850430 None] Create group completed successfully. Apr 09 16:53:36 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" returned: 0 in 0.521s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:36 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a is being set with open permissions: ugo+rw Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:36 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a Apr 09 16:53:36 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Flow 'volume_create_manager' (2ff21b0b-d5f0-4597-aeef-17b67c41cdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2304143-6d48-4ecd-b5e7-69f09ec23fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2304143-6d48-4ecd-b5e7-69f09ec23fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1669999517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88388b63-c48c-495d-a6cc-38a5daceef5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd531ef0e94f51a88cd06c7725e550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:37Z,use_quota=True,user_id='3fbd0cbf9b164d739a80febc7090bc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7dc261-fcb2-4bf5-9a8b-93a828af7570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7dc261-fcb2-4bf5-9a8b-93a828af7570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4d9a0c-8e99-4ba8-aae2-353eeeb85047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4d9a0c-8e99-4ba8-aae2-353eeeb85047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88388b63-c48c-495d-a6cc-38a5daceef5e', 'volume_name': 'volume-88388b63-c48c-495d-a6cc-38a5daceef5e', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b25d38-4a2a-4e11-b2e7-370ec938ffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b25d38-4a2a-4e11-b2e7-370ec938ffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798339a1-9cec-4b64-8e7a-d8fdd7317702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:36 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Volume 88388b63-c48c-495d-a6cc-38a5daceef5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88388b63-c48c-495d-a6cc-38a5daceef5e', 'volume_size': 1} Apr 09 16:53:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:37 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" returned: 0 in 0.621s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:37 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.info Apr 09 16:53:37 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Flow 'volume_create_manager' (a9ad1dee-0b3a-4812-9bf3-e68f40967320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf025b9-eace-4b86-b181-939ea0bd6e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf025b9-eace-4b86-b181-939ea0bd6e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-754425128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4bc97601-9b43-43cb-b355-a2aedd6c6aa4,host='devstack@QuobyteHD#QuobyteHD',id=e75bbc44-9ad2-4e41-889e-01291bd35f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7894e12da39a42b89d6fa646b125fcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:37Z,use_quota=True,user_id='24983adceec84e6eb389c0a244ed8e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6de577bd-780e-4ef2-982b-c97b870eb19c),volume_type_id=6de577bd-780e-4ef2-982b-c97b870eb19c)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5292e2ee-f4e0-41a8-93d0-6a8a996db067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5292e2ee-f4e0-41a8-93d0-6a8a996db067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f06afd7-fdd1-4ab4-ba0c-e02cfb784a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f06afd7-fdd1-4ab4-ba0c-e02cfb784a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75bbc44-9ad2-4e41-889e-01291bd35f73', 'volume_name': 'volume-e75bbc44-9ad2-4e41-889e-01291bd35f73', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f62c76-cf68-4d37-8cee-6e82e5068239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f62c76-cf68-4d37-8cee-6e82e5068239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f92d7e3-7d6c-4ac2-86fc-626d25e18832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:37 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Volume e75bbc44-9ad2-4e41-889e-01291bd35f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75bbc44-9ad2-4e41-889e-01291bd35f73', 'volume_size': 1} Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:37 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.info" returned: 0 in 0.587s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:37 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.info is being set with open permissions: ugo+rw Apr 09 16:53:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:37 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.info Apr 09 16:53:37 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:38 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.info" returned: 0 in 0.417s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.434s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1669999517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88388b63-c48c-495d-a6cc-38a5daceef5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd531ef0e94f51a88cd06c7725e550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:37Z,use_quota=True,user_id='3fbd0cbf9b164d739a80febc7090bc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Creating volume 88388b63-c48c-495d-a6cc-38a5daceef5e {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:53:38 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:38 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e 1073741824 Apr 09 16:53:38 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:38 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c3e11d2a-f865-4aef-b719-91fc3e8d6321 tempest-VolumesSnapshotListTestJSON-1980145437 None] Create snapshot completed successfully Apr 09 16:53:38 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e 1073741824" returned: 0 in 0.545s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:38 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e Apr 09 16:53:38 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:39 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e" returned: 0 in 0.508s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.694s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4bc97601-9b43-43cb-b355-a2aedd6c6aa4,created_at=2026-04-09T14:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-754425128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4bc97601-9b43-43cb-b355-a2aedd6c6aa4,host='devstack@QuobyteHD#QuobyteHD',id=e75bbc44-9ad2-4e41-889e-01291bd35f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7894e12da39a42b89d6fa646b125fcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:37Z,use_quota=True,user_id='24983adceec84e6eb389c0a244ed8e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6de577bd-780e-4ef2-982b-c97b870eb19c),volume_type_id=6de577bd-780e-4ef2-982b-c97b870eb19c)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Creating volume e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:53:39 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798339a1-9cec-4b64-8e7a-d8fdd7317702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88388b63-c48c-495d-a6cc-38a5daceef5e', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:39 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 1073741824 Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ba54d8-9fa2-4fbe-ad83-d01bfd652e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:39 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Volume volume-88388b63-c48c-495d-a6cc-38a5daceef5e (88388b63-c48c-495d-a6cc-38a5daceef5e): created successfully Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ba54d8-9fa2-4fbe-ad83-d01bfd652e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Flow 'volume_create_manager' (2ff21b0b-d5f0-4597-aeef-17b67c41cdc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:39 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-aeb45e73-138c-418f-bf4b-98bd0f04646f tempest-VolumeQuotasAdminTestJSON-1707969484 None] Created volume successfully. Apr 09 16:53:39 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 1073741824" returned: 0 in 0.511s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:39 devstack sudo[85618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 Apr 09 16:53:39 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Acquiring lock "cinder-88388b63-c48c-495d-a6cc-38a5daceef5e-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "cinder-88388b63-c48c-495d-a6cc-38a5daceef5e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Acquiring lock "cinder-quobyte-88388b63-c48c-495d-a6cc-38a5daceef5e" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "cinder-quobyte-88388b63-c48c-495d-a6cc-38a5daceef5e" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6e46bf-4ea3-4626-8c5a-5b7b34e034cd]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:40 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e Apr 09 16:53:40 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:40 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73" returned: 0 in 0.603s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.252s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f92d7e3-7d6c-4ac2-86fc-626d25e18832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75bbc44-9ad2-4e41-889e-01291bd35f73', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb24fc58-085c-478b-a9a3-de725981feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:40 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Volume volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 (e75bbc44-9ad2-4e41-889e-01291bd35f73): created successfully Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb24fc58-085c-478b-a9a3-de725981feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Flow 'volume_create_manager' (a9ad1dee-0b3a-4812-9bf3-e68f40967320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Creating offline snapshot 819cf6f3-8c1d-48a7-ad92-c930b7930ab4 of volume e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:53:40 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-82d127f7-fb88-4813-9225-a07ce8a0cb00 tempest-GroupsV314Test-1739850430 None] Created volume successfully. Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff89bf8e-80d7-4760-8c6c-c997e54fac18]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:40 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e" returned: 0 in 0.561s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:40 devstack sudo[85627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e Apr 09 16:53:40 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:40 devstack sudo[85626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a Apr 09 16:53:40 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:41 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-88388b63-c48c-495d-a6cc-38a5daceef5e" returned: 0 in 0.428s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "cinder-quobyte-88388b63-c48c-495d-a6cc-38a5daceef5e" released by "delete_volume" :: held 1.013s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Created reservations ['71715d5e-ec7d-4a0d-89a7-51babfb925e6', '3b73b489-075f-4437-861c-f817e573b137', '01527e8b-23be-4d16-89c2-125f18f80925', 'd068d89f-8d85-4b52-aa17-aef29a5eaad5'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:41 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" returned: 0 in 0.562s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:41 devstack sudo[85634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 1G Apr 09 16:53:41 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:41 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:41 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:41 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 1G" returned: 0 in 0.662s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:41 devstack sudo[85667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 Apr 09 16:53:41 devstack sudo[85667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:41 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.644s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:41 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Deleted volume successfully. Apr 09 16:53:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3f1e8333-70eb-40b4-bada-8cf731634b9c tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "cinder-88388b63-c48c-495d-a6cc-38a5daceef5e-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:42 devstack sudo[85667]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4" returned: 0 in 0.670s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:42 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 is being set with open permissions: ugo+rw Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:53:42 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 Apr 09 16:53:42 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Flow 'volume_create_manager' (046abd79-4849-4d71-a9d0-c00f5026bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab83fe81-971e-45bc-b94d-c2da10347a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab83fe81-971e-45bc-b94d-c2da10347a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-955816114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd531ef0e94f51a88cd06c7725e550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:42Z,use_quota=True,user_id='3fbd0cbf9b164d739a80febc7090bc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d87e2fc-d279-48e0-8f1b-ed88dab2f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d87e2fc-d279-48e0-8f1b-ed88dab2f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d681b8a5-618d-4b17-8875-d87a11c5638c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d681b8a5-618d-4b17-8875-d87a11c5638c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5', 'volume_name': 'volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b5aada-2bff-4e21-ab1c-1576e804942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b5aada-2bff-4e21-ab1c-1576e804942c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcf16de-ac65-43bb-9aeb-8e95e3aa2dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:42 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Volume e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5', 'volume_size': 1} Apr 09 16:53:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:43 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4" returned: 0 in 0.556s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.329s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:43 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Cloning volume e75bbc44-9ad2-4e41-889e-01291bd35f73 to volume 2c455058-f5f9-4a24-9df6-26caf4e2c9e5 Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Creating offline snapshot 54d677d9-b6e2-40ab-bdd2-fc59c57ef082 of volume e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1ff5db-dd2c-4f7d-8624-162f85b20733]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:43 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-417e878f-e61b-4c2a-9e26-615481839928 tempest-VolumesSnapshotListTestJSON-1980145437 None] Create snapshot completed successfully Apr 09 16:53:43 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 Apr 09 16:53:43 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:43 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73" returned: 0 in 0.669s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:43 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 1G Apr 09 16:53:43 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:44 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 1G" returned: 0 in 0.610s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:44 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 Apr 09 16:53:44 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:44 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082" returned: 0 in 0.488s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:44 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:53:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:44 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 Apr 09 16:53:44 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:45 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082" returned: 0 in 0.425s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:45 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.info Apr 09 16:53:45 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:45 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.info" returned: 0 in 0.444s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:45 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:53:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:45 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.info Apr 09 16:53:45 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:46 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.info" returned: 0 in 0.494s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Acquiring lock "cinder-quobyte-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Lock "cinder-quobyte-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] snapshot: 54d677d9-b6e2-40ab-bdd2-fc59c57ef082, volume: 2c455058-f5f9-4a24-9df6-26caf4e2c9e5, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bbbe3e-8bfd-4823-ac70-15b5705be850]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:46 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 Apr 09 16:53:46 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:46 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082" returned: 0 in 0.469s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e75bbc44-9ad2-4e41-889e-01291bd35f73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0dbf36-2d8a-49ad-9ca9-7fb695d39d59]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:46 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 Apr 09 16:53:46 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:47 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-39d48d5c-51d9-424e-8084-75f8d67fb6cc tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Terminate volume connection completed successfully. Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-39d48d5c-51d9-424e-8084-75f8d67fb6cc tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Deleting attachment f2a7e7a9-f709-43be-a9b6-bc467b325fd9. {{(pid=82139) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 16:53:47 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73" returned: 0 in 0.476s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:47 devstack sudo[85763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 Apr 09 16:53:47 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "cinder-51a552f8-28aa-43e6-8ca7-ae3a26bee291-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "cinder-51a552f8-28aa-43e6-8ca7-ae3a26bee291-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "cinder-quobyte-51a552f8-28aa-43e6-8ca7-ae3a26bee291" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "cinder-quobyte-51a552f8-28aa-43e6-8ca7-ae3a26bee291" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:47 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2a62c-6279-4910-8a4a-929ce7971f78]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:48 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:48 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:49 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 0 in 1.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:49 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:49 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:49 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" returned: 0 in 2.439s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:49 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01bd5d6-8a14-4ca3-a46d-dd203a6c7bff]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:49 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 Apr 09 16:53:49 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:50 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 1 in 0.587s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:50 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291 Apr 09 16:53:50 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:50 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73" returned: 0 in 0.603s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:53:50 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Converted 1024.00 MB image at 419.59 MB/s Apr 09 16:53:50 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:50 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 Apr 09 16:53:50 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:50 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-51a552f8-28aa-43e6-8ca7-ae3a26bee291" returned: 0 in 0.438s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "cinder-quobyte-51a552f8-28aa-43e6-8ca7-ae3a26bee291" released by "delete_volume" :: held 2.564s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.quota [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Created reservations ['4bd69272-7e5f-45a0-bfca-0e76033f02ff', '411aa9b9-673b-4e12-af8a-790b3909376a', 'efc87acd-6911-4365-bda8-45f4b231b34a', 'cfeb37b5-6169-48f8-8350-d3ed4cf4a24b'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:50 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:50 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:50 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" returned: 0 in 0.431s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Lock "cinder-quobyte-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" released by "_copy_volume_from_snapshot" :: held 4.462s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Acquiring lock "cinder-quobyte-54d677d9-b6e2-40ab-bdd2-fc59c57ef082" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Lock "cinder-quobyte-54d677d9-b6e2-40ab-bdd2-fc59c57ef082" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Deleting offline snapshot 54d677d9-b6e2-40ab-bdd2-fc59c57ef082 of volume e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] snapshot_file for this snap is: volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f90ae-51f7-4c02-a76f-5283f8d3caf6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:50 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 Apr 09 16:53:50 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:51 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.450s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG cinder.manager [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Deleted volume successfully. Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-d0bf26da-5360-41b3-8435-fdb561c6b29a req-b5cc476f-c621-492d-992a-77b099dc9823 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "cinder-51a552f8-28aa-43e6-8ca7-ae3a26bee291-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:51 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082" returned: 0 in 0.586s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e75bbc44-9ad2-4e41-889e-01291bd35f73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[36943f6f-28a6-43f4-920e-e78f0440522d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:51 devstack sudo[85818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 Apr 09 16:53:51 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:51 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73" returned: 0 in 0.485s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:51 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 Apr 09 16:53:51 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:52 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082" returned: 0 in 0.550s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:52 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082 Apr 09 16:53:52 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:52 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73.54d677d9-b6e2-40ab-bdd2-fc59c57ef082" returned: 0 in 0.487s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Lock "cinder-quobyte-54d677d9-b6e2-40ab-bdd2-fc59c57ef082" released by "_delete_snapshot" :: held 2.159s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.886s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.355s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-955816114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd531ef0e94f51a88cd06c7725e550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:53:42Z,use_quota=True,user_id='3fbd0cbf9b164d739a80febc7090bc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Creating volume e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:53:52 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:53:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:52 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 1073741824 Apr 09 16:53:52 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-fc239738-219b-4e63-8dc9-74979573de82 tempest-GroupsV314Test-1739850430 None] Create group from source-group-4bc97601-9b43-43cb-b355-a2aedd6c6aa4 completed successfully. Apr 09 16:53:53 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 1073741824" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:53 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 Apr 09 16:53:53 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:53 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5" returned: 0 in 0.518s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.387s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcf16de-ac65-43bb-9aeb-8e95e3aa2dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304c07de-3180-41af-b7c9-259d4746132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:53:53 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Volume volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 (e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5): created successfully Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304c07de-3180-41af-b7c9-259d4746132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:53:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Flow 'volume_create_manager' (046abd79-4849-4d71-a9d0-c00f5026bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Acquiring lock "cinder-quobyte-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-02701083-1c03-46ce-b897-ad899f11b0ac tempest-VolumeQuotasAdminTestJSON-1707969484 None] Created volume successfully. Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Creating offline snapshot 60cd8c38-ea02-40ad-ac06-81acb141e629 of volume e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Lock "cinder-quobyte-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" acquired by "delete_volume" :: waited 0.032s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[06749cd8-7bac-4058-ba28-2d2c68084212]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[20abbf95-f933-4749-8b16-5f59e32ac61c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:54 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 Apr 09 16:53:54 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:54 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 Apr 09 16:53:54 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:54 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:54 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-df0cbc7a-bcb6-4bab-9d75-e0884eecffb2 tempest-VolumeQuotasAdminTestJSON-1968463394 None] Transfer volume completed successfully. Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4" returned: 0 in 0.562s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" returned: 0 in 0.560s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:54 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 1G Apr 09 16:53:54 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:54 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5 Apr 09 16:53:54 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:55 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" returned: 0 in 0.512s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Lock "cinder-quobyte-2c455058-f5f9-4a24-9df6-26caf4e2c9e5" released by "delete_volume" :: held 1.102s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Created reservations ['8767862f-7b14-472c-b7e6-37d3a38644ea'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:55 devstack cinder-volume[82139]: WARNING cinder.quota [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1410677922 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1410677922, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:55 devstack cinder-volume[82139]: WARNING cinder.quota [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1410677922 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1410677922, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:53:55 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Created reservations ['c9f7d086-4290-499f-8246-0963d5c8cf6c', '932f1b5b-83d8-4fb2-a869-524f8eae6c51', 'cd712682-4839-4938-ba92-4b0af0a3a6fc', '3ac75e2c-06f1-4991-8e4b-86e6dd308394'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 1G" returned: 0 in 0.607s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:55 devstack sudo[85887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 Apr 09 16:53:55 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:55 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:55 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Acquiring lock "cinder-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Lock "cinder-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Acquiring lock "cinder-quobyte-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Lock "cinder-quobyte-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3e7434-ad5f-485b-b91a-6f2c7ab4e533]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:55 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 Apr 09 16:53:55 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:55 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629" returned: 0 in 0.484s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:55 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 is being set with open permissions: ugo+rw Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:55 devstack sudo[85896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 Apr 09 16:53:55 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:55 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.478s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:55 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a6156766-b3a3-4b44-80f2-e79d21fca998 tempest-GroupsV314Test-1739850430 None] Delete group completed successfully. Apr 09 16:53:55 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5" returned: 0 in 0.534s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:56 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5 Apr 09 16:53:56 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:56 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:56 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4e037845-f4c5-4731-8413-67f24a725eba tempest-VolumesSnapshotListTestJSON-1980145437 None] Create snapshot completed successfully Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Acquiring lock "cinder-quobyte-e75bbc44-9ad2-4e41-889e-01291bd35f73" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Lock "cinder-quobyte-e75bbc44-9ad2-4e41-889e-01291bd35f73" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0960ab-c9ef-4e88-b893-adc10ab050d7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:56 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 Apr 09 16:53:56 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:56 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5" returned: 0 in 0.429s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Lock "cinder-quobyte-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5" released by "delete_volume" :: held 0.983s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Created reservations ['dcce349d-4ac5-4220-9f44-93d5d87d4309', '2ad886f3-5eeb-44a3-8e63-c7fe4cb4dd82', '646e56dc-df0c-48d9-b810-98e7a2f5d509', '0e73b25c-8e4d-4585-8784-7b8190e55cf7'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:56 devstack sudo[85908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:56 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:56 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73" returned: 0 in 0.534s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:56 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73 Apr 09 16:53:56 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:56 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:56 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:56 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Deleted volume successfully. Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b989b960-7e98-48ab-8d62-3d4a99bd395f tempest-VolumeQuotasAdminTestJSON-253615112 None] Lock "cinder-e0f049c1-a3ee-44f2-9c2d-1dd5fb346fe5-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:57 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e75bbc44-9ad2-4e41-889e-01291bd35f73" returned: 0 in 0.596s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Lock "cinder-quobyte-e75bbc44-9ad2-4e41-889e-01291bd35f73" released by "delete_volume" :: held 1.177s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Created reservations ['dd3257ca-2e87-4cc1-9110-8abf00d7db41'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Created reservations ['5ff50683-8e59-4845-89e2-439609101b3a', 'cbf5df61-783e-4411-a3c0-81551bb23170', '8f773bc1-c46a-4130-82c1-e0d330846a1f', '93b57ceb-1dd4-4f36-960b-9cdd03bf5127'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:57 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:53:57 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-60cd8c38-ea02-40ad-ac06-81acb141e629-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-60cd8c38-ea02-40ad-ac06-81acb141e629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-quobyte-60cd8c38-ea02-40ad-ac06-81acb141e629" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-60cd8c38-ea02-40ad-ac06-81acb141e629" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Deleting offline snapshot 60cd8c38-ea02-40ad-ac06-81acb141e629 of volume e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] snapshot_file for this snap is: volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e7feea-4619-4a13-bd0f-692545aa77a1]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:57 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 Apr 09 16:53:57 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:58 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.495s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:58 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:53:58 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c6737c97-ec25-4641-9a97-455961b41d50 tempest-GroupsV314Test-1739850430 None] Delete group completed successfully. Apr 09 16:53:58 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629" returned: 0 in 0.579s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:58 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a97b5-fcb5-47be-8655-fb3a3151f97b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:53:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:58 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 Apr 09 16:53:58 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:59 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4" returned: 0 in 0.672s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:53:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:59 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 Apr 09 16:53:59 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:53:59 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 09 16:53:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629" returned: 0 in 0.718s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:53:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:53:59 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629 Apr 09 16:53:59 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:00 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.60cd8c38-ea02-40ad-ac06-81acb141e629" returned: 0 in 0.543s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-60cd8c38-ea02-40ad-ac06-81acb141e629" released by "_delete_snapshot" :: held 2.571s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" released by "delete_snapshot" :: held 2.585s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:00 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Created reservations ['493943f4-d047-4105-b72c-d7424ace1e8c', '6f0638a6-5594-4f14-bacf-61de2f1255a3', '11019358-0299-401a-910f-2d11f7894467', 'c68b5923-41b1-4ef8-9d39-79d0d76505d2'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:00 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Delete snapshot completed successfully. Apr 09 16:54:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d1b554e8-bf72-4c2c-ad86-77b909370349 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-60cd8c38-ea02-40ad-ac06-81acb141e629-delete_snapshot" released by "delete_snapshot" :: held 2.696s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-819cf6f3-8c1d-48a7-ad92-c930b7930ab4-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-819cf6f3-8c1d-48a7-ad92-c930b7930ab4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-quobyte-819cf6f3-8c1d-48a7-ad92-c930b7930ab4" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-819cf6f3-8c1d-48a7-ad92-c930b7930ab4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Deleting offline snapshot 819cf6f3-8c1d-48a7-ad92-c930b7930ab4 of volume e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] snapshot_file for this snap is: volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ebefb2-fac6-44aa-b3d3-09fc63370488]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:01 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 Apr 09 16:54:01 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:01 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Flow 'volume_create_manager' (73184970-ae9c-4380-ac71-9c4495257e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aabf4ab-a204-4cdc-8c06-b667ac98d480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aabf4ab-a204-4cdc-8c06-b667ac98d480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-947527545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce51354f-c65d-4895-8bf5-019a7a1ba6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb796200d8b4233bc5a05fb3df89803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:02Z,use_quota=True,user_id='f7148d48ea6e433fbdb6497636002202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56a45de-1599-4ccc-a48e-d6d27b0aee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56a45de-1599-4ccc-a48e-d6d27b0aee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f135b9a-59e4-48ad-b6f0-cc1c115a2bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f135b9a-59e4-48ad-b6f0-cc1c115a2bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce51354f-c65d-4895-8bf5-019a7a1ba6e5', 'volume_name': 'volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7126b935-f961-4d87-8c2d-50a07f28cc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7126b935-f961-4d87-8c2d-50a07f28cc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a6ccda-6642-426f-ad35-85076da3cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:01 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Volume ce51354f-c65d-4895-8bf5-019a7a1ba6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5', 'volume_size': 1} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-947527545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce51354f-c65d-4895-8bf5-019a7a1ba6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb796200d8b4233bc5a05fb3df89803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:02Z,use_quota=True,user_id='f7148d48ea6e433fbdb6497636002202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Creating volume ce51354f-c65d-4895-8bf5-019a7a1ba6e5 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:01 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4" returned: 0 in 0.710s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:01 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 1073741824 Apr 09 16:54:01 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cf260f-be79-4603-bd98-40f16b735eaf]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:01 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a Apr 09 16:54:01 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-34fd21e0-2efe-4e95-a2d5-9aeef5cc3b6b tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Terminate volume connection completed successfully. Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-34fd21e0-2efe-4e95-a2d5-9aeef5cc3b6b tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Deleting attachment 3db97a63-dbc8-4908-81a5-131f5693cf2c. {{(pid=82139) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 16:54:02 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 1073741824" returned: 0 in 0.585s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:02 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" returned: 0 in 0.566s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:02 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 Apr 09 16:54:02 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:02 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 Apr 09 16:54:02 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d483c656-2edd-4f78-981e-a218a88a7040 tempest-GroupsV320Test-1272759915 None] Group tempest-GroupsV320Test-Group-1482669364: creating Apr 09 16:54:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d483c656-2edd-4f78-981e-a218a88a7040 tempest-GroupsV320Test-1272759915 None] Group tempest-GroupsV320Test-Group-1482669364: created successfully Apr 09 16:54:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d483c656-2edd-4f78-981e-a218a88a7040 tempest-GroupsV320Test-1272759915 None] Create group completed successfully. Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "cinder-bd42cb13-2631-4e78-bc61-1c28e150e17c-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "cinder-bd42cb13-2631-4e78-bc61-1c28e150e17c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "cinder-quobyte-bd42cb13-2631-4e78-bc61-1c28e150e17c" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:02 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5" returned: 0 in 0.476s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "cinder-quobyte-bd42cb13-2631-4e78-bc61-1c28e150e17c" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a6ccda-6642-426f-ad35-85076da3cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376a8972-4657-48b3-ab3e-1ef9e4e93be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[73753903-b791-4fd1-9e29-1cba6f914b09]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:02 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Volume volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 (ce51354f-c65d-4895-8bf5-019a7a1ba6e5): created successfully Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376a8972-4657-48b3-ab3e-1ef9e4e93be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Flow 'volume_create_manager' (73184970-ae9c-4380-ac71-9c4495257e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6df2421c-11ee-4190-b0d3-ccc9c7c8d09d tempest-VolumesServicesTestJSON-974477131 None] Created volume successfully. Apr 09 16:54:02 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4" returned: 0 in 0.564s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:02 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4 Apr 09 16:54:02 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:02 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c Apr 09 16:54:02 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:03 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.819cf6f3-8c1d-48a7-ad92-c930b7930ab4" returned: 0 in 0.416s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-819cf6f3-8c1d-48a7-ad92-c930b7930ab4" released by "_delete_snapshot" :: held 2.350s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" released by "delete_snapshot" :: held 2.366s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:03 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c" returned: 0 in 0.508s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Created reservations ['92e9f73d-87c7-4607-a674-61826b131bce', '9bab1940-8595-4e30-9d5b-c6dfe4a9b59c', 'a54f6b5a-9aa3-4a99-8d92-4d040cf56032', 'b1318fc8-c5d5-4eef-a8b5-1c622f81db22'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:03 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c Apr 09 16:54:03 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Delete snapshot completed successfully. Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29339683-af15-406c-b63a-13e44127ff74 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-819cf6f3-8c1d-48a7-ad92-c930b7930ab4-delete_snapshot" released by "delete_snapshot" :: held 2.503s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:03 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bd42cb13-2631-4e78-bc61-1c28e150e17c" returned: 0 in 0.455s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "cinder-quobyte-bd42cb13-2631-4e78-bc61-1c28e150e17c" released by "delete_volume" :: held 1.019s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG cinder.quota [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Created reservations ['3b8def5d-8c2e-4b08-a4ee-7e1bdf13ee35', 'ea99333c-4942-4c6e-85cb-fae8fb35e8a1', '8af1aaaf-6e3e-487c-82d8-78e82135bb8b', '0bbbf0f6-6102-49bf-97ca-3804c9b75cc5'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Acquiring lock "cinder-ce51354f-c65d-4895-8bf5-019a7a1ba6e5-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Lock "cinder-ce51354f-c65d-4895-8bf5-019a7a1ba6e5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:04 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:04 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Acquiring lock "cinder-quobyte-ce51354f-c65d-4895-8bf5-019a7a1ba6e5" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Lock "cinder-quobyte-ce51354f-c65d-4895-8bf5-019a7a1ba6e5" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bf9b10-09ea-4b9b-8aaa-edbdbc0802ed]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Created reservations ['76f77827-eb4d-4f6c-aafa-0f5753781b4c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-f9eb56c9-5c73-4fde-84c5-4bfc19211a2a-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:04 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 Apr 09 16:54:04 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-f9eb56c9-5c73-4fde-84c5-4bfc19211a2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:04 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:04 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-quobyte-f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Deleting offline snapshot f9eb56c9-5c73-4fde-84c5-4bfc19211a2a of volume e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] snapshot_file for this snap is: volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[2149aa82-8264-4708-aefb-cd9bc28af3b4]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:04 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a Apr 09 16:54:04 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:04 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.450s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.manager [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:04 devstack cinder-volume[82139]: INFO cinder.volume.manager [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Deleted volume successfully. Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [req-83f1a5b5-f0e1-4fa5-be8b-2b4bf4c74dbe req-9a7b809c-72c7-4a82-bc43-aef4894679b7 tempest-ServerBootFromVolumeStableRescueTest-155053648 None] Lock "cinder-bd42cb13-2631-4e78-bc61-1c28e150e17c-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:04 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5" returned: 0 in 0.537s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:04 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5 Apr 09 16:54:04 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:04 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.505s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:04 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1f2d0444-1bbf-444e-a5e6-cab939b2cc75 tempest-GroupsV320Test-1272759915 None] Delete group completed successfully. Apr 09 16:54:04 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" returned: 0 in 0.506s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b083ab-c6f5-49fd-8009-095994d3e63e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:04 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f Apr 09 16:54:04 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:05 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce51354f-c65d-4895-8bf5-019a7a1ba6e5" returned: 0 in 0.459s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Lock "cinder-quobyte-ce51354f-c65d-4895-8bf5-019a7a1ba6e5" released by "delete_volume" :: held 1.049s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Created reservations ['61f18ce2-2e5a-4c7e-93fd-2727a2d0680c', '892eb8c5-13bc-4f24-91a7-c39ed8327588', '12a7b6bf-7971-4885-95a5-3939de5bd4d5', '59d5b6d3-3543-42d4-887d-49bb06b5432d'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:05 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:05 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:05 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f" returned: 0 in 0.526s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:05 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a Apr 09 16:54:05 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:05 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.487s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:05 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Deleted volume successfully. Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9551c3a5-d534-43be-94fe-e995566908f3 tempest-VolumesServicesTestJSON-974477131 None] Lock "cinder-ce51354f-c65d-4895-8bf5-019a7a1ba6e5-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:05 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" returned: 0 in 0.565s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:05 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a Apr 09 16:54:05 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:06 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f.f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" returned: 0 in 0.562s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-f9eb56c9-5c73-4fde-84c5-4bfc19211a2a" released by "_delete_snapshot" :: held 2.216s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" released by "delete_snapshot" :: held 2.227s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:06 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Created reservations ['53cd1899-fa03-4341-8a24-b0b5ce3f2698', 'c46c4a5e-68fe-429d-967f-d4fb04dfd23e', '4c10c708-5f63-4d24-b208-7ceb8ddd531d', '75296d0f-1d17-438b-9ae6-cd00d5f7ec31'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Delete snapshot completed successfully. Apr 09 16:54:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e794d3c5-c3a1-4d00-af6b-fe1b699e34c9 tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-f9eb56c9-5c73-4fde-84c5-4bfc19211a2a-delete_snapshot" released by "delete_snapshot" :: held 2.346s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-e3eace4b-ab82-4b00-a2e9-56cbca06055f-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-e3eace4b-ab82-4b00-a2e9-56cbca06055f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:07 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb593af-baae-4294-ac9e-bf16e934946a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:07 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f Apr 09 16:54:07 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:08 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f" returned: 0 in 0.613s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:08 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f Apr 09 16:54:08 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:08 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e3eace4b-ab82-4b00-a2e9-56cbca06055f" returned: 0 in 0.498s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-quobyte-e3eace4b-ab82-4b00-a2e9-56cbca06055f" released by "delete_volume" :: held 1.146s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Created reservations ['21ecef08-1123-4a4f-b066-a76c81344e2d', '28db5094-c8f6-47c7-bc0f-2912167777f3', '5a428324-6acf-4ea6-b689-9a544618e690', '80b0ffcb-83cb-421d-92cf-a9eefd4796a6'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:08 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:08 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:08 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Flow 'volume_create_manager' (d5ab6f1b-46e4-49d2-b056-5b6d51f92704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ecdd8a-0bea-4567-be20-0d521f2cc96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ecdd8a-0bea-4567-be20-0d521f2cc96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-941562383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3032058c-b8de-4644-b4b9-e8830cd21c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392dde4763e45cb8da8dcade3f7adb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:09Z,use_quota=True,user_id='74d2373fca5645fcb4a3446df751c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b2cbff-1dc0-49aa-b6df-a7720f321a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b2cbff-1dc0-49aa-b6df-a7720f321a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20ffa69-5056-41de-9f2b-474d81971096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20ffa69-5056-41de-9f2b-474d81971096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3032058c-b8de-4644-b4b9-e8830cd21c7a', 'volume_name': 'volume-3032058c-b8de-4644-b4b9-e8830cd21c7a', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5576eeec-57aa-4409-9146-757ecf65051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5576eeec-57aa-4409-9146-757ecf65051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7828d3d6-6e72-48b4-a7b4-8fade9b139ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:09 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Volume 3032058c-b8de-4644-b4b9-e8830cd21c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3032058c-b8de-4644-b4b9-e8830cd21c7a', 'volume_size': 1} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-941562383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3032058c-b8de-4644-b4b9-e8830cd21c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c392dde4763e45cb8da8dcade3f7adb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:09Z,use_quota=True,user_id='74d2373fca5645fcb4a3446df751c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Creating volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:09 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:09 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a 1073741824 Apr 09 16:54:09 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:09 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:09 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Deleted volume successfully. Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ff06b449-9e53-4908-bc6f-d968de64d66b tempest-VolumesSnapshotListTestJSON-1980145437 None] Lock "cinder-e3eace4b-ab82-4b00-a2e9-56cbca06055f-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:09 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a 1073741824" returned: 0 in 0.569s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:09 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a Apr 09 16:54:09 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:10 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a" returned: 0 in 0.546s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:10 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7828d3d6-6e72-48b4-a7b4-8fade9b139ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3032058c-b8de-4644-b4b9-e8830cd21c7a', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d87fed-d4ae-4a9a-a1ef-72849a785f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:10 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Volume volume-3032058c-b8de-4644-b4b9-e8830cd21c7a (3032058c-b8de-4644-b4b9-e8830cd21c7a): created successfully Apr 09 16:54:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d87fed-d4ae-4a9a-a1ef-72849a785f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Flow 'volume_create_manager' (d5ab6f1b-46e4-49d2-b056-5b6d51f92704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:10 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-09ab5739-5c5f-4fe9-9d2c-688fff89134f tempest-SnapshotsActionsTest-1811189476 None] Created volume successfully. Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Creating offline snapshot efc14f7c-de57-4022-a7ae-61c15e07bda5 of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92bc5eb-83f7-47cb-81e9-e9266606aa08]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:11 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a Apr 09 16:54:11 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (495b891d-8e3f-4ae4-abbe-af970b009b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4041ce-f513-42dd-8145-90e42cbc38d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4041ce-f513-42dd-8145-90e42cbc38d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1089226927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4081ab-40c4-4116-b579-0a1660bf64f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:12Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f89835e-1fa3-490d-a6ad-e96c497a3a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f89835e-1fa3-490d-a6ad-e96c497a3a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fefae22-9ac3-4fb7-9340-c140a038eb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fefae22-9ac3-4fb7-9340-c140a038eb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4081ab-40c4-4116-b579-0a1660bf64f8', 'volume_name': 'volume-0a4081ab-40c4-4116-b579-0a1660bf64f8', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a60151a-56c6-4b45-982d-8363415f4a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a60151a-56c6-4b45-982d-8363415f4a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99b20a3-40a4-4a01-b922-da0442d3f8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Volume 0a4081ab-40c4-4116-b579-0a1660bf64f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4081ab-40c4-4116-b579-0a1660bf64f8', 'volume_size': 1} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (57708a66-5a4f-4404-ad2b-59a3630dc7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd0821c-8ff9-4c1d-ad5e-d9e78762fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd0821c-8ff9-4c1d-ad5e-d9e78762fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1051801033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac70d29-5897-4e61-a5ed-0faf0a0d3a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:12Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e62ad8-f960-4e74-85da-70ec126d0f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e62ad8-f960-4e74-85da-70ec126d0f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e63d234-012a-42af-989a-22cf997a92bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e63d234-012a-42af-989a-22cf997a92bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac70d29-5897-4e61-a5ed-0faf0a0d3a16', 'volume_name': 'volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5c67fb-88e3-4a1a-968a-a629694e22eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5c67fb-88e3-4a1a-968a-a629694e22eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ec060a-cca6-4333-89c5-29eece427061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Volume 6ac70d29-5897-4e61-a5ed-0faf0a0d3a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16', 'volume_size': 1} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a" returned: 0 in 0.676s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:12 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 1G Apr 09 16:54:12 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (a6fda3d2-a06c-4766-8d72-563b494534f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86551004-1e2e-47e2-a26c-00743f9a386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86551004-1e2e-47e2-a26c-00743f9a386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997424876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f5b76b-2c1e-41f0-86cb-fc38a2051436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:12Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86606616-c2a9-4f74-8d55-1e8f80b0df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86606616-c2a9-4f74-8d55-1e8f80b0df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018c2ba1-4667-4cc7-ac75-1660f61e7d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018c2ba1-4667-4cc7-ac75-1660f61e7d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f5b76b-2c1e-41f0-86cb-fc38a2051436', 'volume_name': 'volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c646a3-6924-48cd-a4e1-d01c271ebe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c646a3-6924-48cd-a4e1-d01c271ebe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218aa46a-820b-4d4a-827e-07aa19645cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Volume 11f5b76b-2c1e-41f0-86cb-fc38a2051436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436', 'volume_size': 1} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (8976be02-6329-4b72-905c-0f1d7b2ffa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4356b7-bd72-4651-a23d-6497c49a4073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4356b7-bd72-4651-a23d-6497c49a4073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-520816537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a184823-27c3-415c-9f9d-9778c3cb1150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:12Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbeaaf22-ed06-4dc8-89a0-acf71f96bd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbeaaf22-ed06-4dc8-89a0-acf71f96bd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4011da-b833-4183-bda6-f4b405090394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4011da-b833-4183-bda6-f4b405090394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a184823-27c3-415c-9f9d-9778c3cb1150', 'volume_name': 'volume-0a184823-27c3-415c-9f9d-9778c3cb1150', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d65bfa-3dd1-4377-a15b-daf028b98fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d65bfa-3dd1-4377-a15b-daf028b98fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872cef36-f705-488c-9212-3c0ba21c71dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Volume 0a184823-27c3-415c-9f9d-9778c3cb1150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a184823-27c3-415c-9f9d-9778c3cb1150', 'volume_size': 1} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (f35574d0-3fe5-4eaa-bafa-b9e77efd0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b91afd-eaaa-4b99-bdea-0ee082a59217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b91afd-eaaa-4b99-bdea-0ee082a59217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-592915086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a92e1df-6177-4a88-8022-fb2b182b3ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:13Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15b6958-1e10-458a-bd0f-f2ac185d3061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15b6958-1e10-458a-bd0f-f2ac185d3061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2f22ca-c335-4d6b-8d19-42dd2bacdd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2f22ca-c335-4d6b-8d19-42dd2bacdd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a92e1df-6177-4a88-8022-fb2b182b3ca6', 'volume_name': 'volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ea4c00-5679-4a56-af66-3e8762217445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ea4c00-5679-4a56-af66-3e8762217445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8087d4-dabb-4eb0-9def-4ff21f499518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Volume 0a92e1df-6177-4a88-8022-fb2b182b3ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6', 'volume_size': 1} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:12 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 1G" returned: 0 in 0.726s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:12 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:12 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:13 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.501s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:13 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 is being set with open permissions: ugo+rw Apr 09 16:54:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:13 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:13 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:13 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.512s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:13 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.info Apr 09 16:54:13 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:14 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:14 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:14 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.info" returned: 0 in 0.507s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:14 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.info is being set with open permissions: ugo+rw Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:14 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.info Apr 09 16:54:14 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:14 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.585s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:14 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.info" returned: 0 in 0.542s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.528s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.091s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1089226927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4081ab-40c4-4116-b579-0a1660bf64f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:12Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Creating volume 0a4081ab-40c4-4116-b579-0a1660bf64f8 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:14 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-677ea6dd-3cb4-4708-b87a-3dfa8ba28736 tempest-SnapshotsActionsTest-1811189476 None] Create snapshot completed successfully Apr 09 16:54:14 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 1073741824 Apr 09 16:54:14 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:15 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 1073741824" returned: 0 in 0.710s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:15 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 Apr 09 16:54:15 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:16 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8" returned: 0 in 0.637s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.221s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1051801033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac70d29-5897-4e61-a5ed-0faf0a0d3a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:12Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Creating volume 6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:16 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99b20a3-40a4-4a01-b922-da0442d3f8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4081ab-40c4-4116-b579-0a1660bf64f8', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4726ca6a-5336-46c0-9240-ee061ff00155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:16 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 1073741824 Apr 09 16:54:16 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:16 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Volume volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 (0a4081ab-40c4-4116-b579-0a1660bf64f8): created successfully Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4726ca6a-5336-46c0-9240-ee061ff00155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (495b891d-8e3f-4ae4-abbe-af970b009b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-79a95b9f-5af0-49a9-be8e-21d3eac8adfe tempest-CreateVolumesFromImageTest-1814313989 None] Created volume successfully. Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Flow 'volume_create_manager' (519c95b5-72bc-47f1-bec3-c4abd8c4153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1151a91-9951-44f5-8d65-2736c17e0e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1151a91-9951-44f5-8d65-2736c17e0e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2003721275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6a13eb-2522-4e89-9d2f-3135a5984583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464f49b9a3f64420b252aaaf2284f24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:16Z,use_quota=True,user_id='a9da43e466184d59be1364649cd26a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe47227-ad35-4fa4-b75d-c37e7705878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe47227-ad35-4fa4-b75d-c37e7705878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a14c4e4-2a4e-4507-a252-66ffe4a0396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.image.glance [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Creating Keystone auth plugin from conf {{(pid=82139) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a14c4e4-2a4e-4507-a252-66ffe4a0396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e6a13eb-2522-4e89-9d2f-3135a5984583', 'volume_name': 'volume-0e6a13eb-2522-4e89-9d2f-3135a5984583', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c93dc83-4a97-4ad4-92fb-457286cc801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c93dc83-4a97-4ad4-92fb-457286cc801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90dd7ed-c477-4a9a-abaf-0ff01f66fa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:16 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Volume 0e6a13eb-2522-4e89-9d2f-3135a5984583: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e6a13eb-2522-4e89-9d2f-3135a5984583', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Trying to clone 0e6a13eb-2522-4e89-9d2f-3135a5984583 from image d01216e8-c5dc-4c96-8184-f8935064d568 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]). {{(pid=82139) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 16:54:16 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 1073741824" returned: 0 in 0.622s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:16 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 Apr 09 16:54:16 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:16 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 16:54:16 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Image download 20.69 MB at 20.69 MB/s Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1f8a36-41e0-47bc-b2fa-b5aa6af8ee6e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:17 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD Apr 09 16:54:17 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:17 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16" returned: 0 in 0.471s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.189s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997424876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f5b76b-2c1e-41f0-86cb-fc38a2051436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:12Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Creating volume 11f5b76b-2c1e-41f0-86cb-fc38a2051436 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:17 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=191,cinder:SELECT=162,cinder:DELETE=12,cinder:INSERT=36 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ec060a-cca6-4333-89c5-29eece427061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024ecefb-dbcd-4ee2-a16d-53fe95333954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:17 devstack sudo[86141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 1073741824 Apr 09 16:54:17 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:17 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Volume volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 (6ac70d29-5897-4e61-a5ed-0faf0a0d3a16): created successfully Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024ecefb-dbcd-4ee2-a16d-53fe95333954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (57708a66-5a4f-4404-ad2b-59a3630dc7fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:17 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-031ea098-4276-41d2-be59-8669028ccb57 tempest-CreateVolumesFromImageTest-1814313989 None] Created volume successfully. Apr 09 16:54:17 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD" returned: 0 in 0.580s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Temporary image d01216e8-c5dc-4c96-8184-f8935064d568 is fetched for user a9da43e466184d59be1364649cd26a30. {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba767ae-c9f8-4259-906b-724e2feeb72b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:17 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD Apr 09 16:54:17 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:18 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 1073741824" returned: 0 in 0.667s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=152,cinder:SELECT=148,cinder:INSERT=46,cinder:DELETE=10 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:18 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 Apr 09 16:54:18 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:18 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD" returned: 0 in 0.585s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:18 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436" returned: 0 in 0.419s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-520816537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a184823-27c3-415c-9f9d-9778c3cb1150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:12Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Creating volume 0a184823-27c3-415c-9f9d-9778c3cb1150 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:18 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218aa46a-820b-4d4a-827e-07aa19645cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:18 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 1073741824 Apr 09 16:54:18 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fccd23-7ff0-46cf-8c68-41b49fa3167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:18 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Volume volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 (11f5b76b-2c1e-41f0-86cb-fc38a2051436): created successfully Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fccd23-7ff0-46cf-8c68-41b49fa3167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (a6fda3d2-a06c-4766-8d72-563b494534f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:18 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f1b5b8b2-9a88-43aa-9b79-151fa4002fdc tempest-CreateVolumesFromImageTest-1814313989 None] Created volume successfully. Apr 09 16:54:19 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 1073741824" returned: 0 in 0.544s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:19 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 Apr 09 16:54:19 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:19 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150" returned: 0 in 0.447s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.905s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-592915086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a92e1df-6177-4a88-8022-fb2b182b3ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f0a90ade341b5bb9becf40333ee0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:13Z,use_quota=True,user_id='132d7f0e2f3b4105a687a5540595d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Creating volume 0a92e1df-6177-4a88-8022-fb2b182b3ca6 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:19 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872cef36-f705-488c-9212-3c0ba21c71dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a184823-27c3-415c-9f9d-9778c3cb1150', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5f5b72-f1dd-4e78-9d6d-3917554a61d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:19 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 1073741824 Apr 09 16:54:19 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:19 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Volume volume-0a184823-27c3-415c-9f9d-9778c3cb1150 (0a184823-27c3-415c-9f9d-9778c3cb1150): created successfully Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5f5b72-f1dd-4e78-9d6d-3917554a61d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (8976be02-6329-4b72-905c-0f1d7b2ffa72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:19 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-46bca72c-2466-4366-98af-e5dd09feaa95 tempest-CreateVolumesFromImageTest-1814313989 None] Created volume successfully. Apr 09 16:54:20 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 1073741824" returned: 0 in 0.702s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:20 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 Apr 09 16:54:20 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:20 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6" returned: 0 in 0.504s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.864s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Creating offline snapshot 404af2a8-5bf7-4844-b929-f656dfd01781 of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8087d4-dabb-4eb0-9def-4ff21f499518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0447bd50-902f-429e-8688-6dd5d522411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdedf593-d7ff-4e23-a148-da57e3a69a77]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:20 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Volume volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 (0a92e1df-6177-4a88-8022-fb2b182b3ca6): created successfully Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0447bd50-902f-429e-8688-6dd5d522411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Flow 'volume_create_manager' (f35574d0-3fe5-4eaa-bafa-b9e77efd0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:20 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-55ec99f2-a479-427d-a2a2-2c32bd6a8f33 tempest-CreateVolumesFromImageTest-1814313989 None] Created volume successfully. Apr 09 16:54:20 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:20 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-0a92e1df-6177-4a88-8022-fb2b182b3ca6-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-0a92e1df-6177-4a88-8022-fb2b182b3ca6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-quobyte-0a92e1df-6177-4a88-8022-fb2b182b3ca6" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-0a92e1df-6177-4a88-8022-fb2b182b3ca6" acquired by "delete_volume" :: waited 0.026s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[04de2c16-4597-4d08-a2f1-be3e81277f08]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:21 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 Apr 09 16:54:21 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:21 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.675s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:21 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 1G Apr 09 16:54:21 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:22 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6" returned: 0 in 0.726s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:22 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6 Apr 09 16:54:22 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:22 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 1G" returned: 0 in 0.658s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:22 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 Apr 09 16:54:22 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:22 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a92e1df-6177-4a88-8022-fb2b182b3ca6" returned: 0 in 0.494s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-0a92e1df-6177-4a88-8022-fb2b182b3ca6" released by "delete_volume" :: held 1.246s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Created reservations ['397706c2-5da7-48b7-8850-5f8de5eb43e8', 'b01474ce-1440-4d30-b3be-a0b5753603b0', 'df0be03e-e493-4063-8295-5aafb8554661', '86671394-4d2c-447f-a338-fc80ba6af837'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:22 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781" returned: 0 in 0.562s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:22 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 is being set with open permissions: ugo+rw Apr 09 16:54:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:22 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:22 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:22 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 Apr 09 16:54:22 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:23 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781" returned: 0 in 0.531s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.496s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.048s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2003721275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6a13eb-2522-4e89-9d2f-3135a5984583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464f49b9a3f64420b252aaaf2284f24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:16Z,use_quota=True,user_id='a9da43e466184d59be1364649cd26a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Creating volume 0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:23 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:23 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:23 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 1073741824 Apr 09 16:54:23 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.611s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:23 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1a826544-7d51-4042-8a5b-1d0cf3a1a9fe tempest-SnapshotsActionsTest-1811189476 None] Create snapshot completed successfully Apr 09 16:54:23 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Deleted volume successfully. Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b724a4aa-2ea2-4089-89e2-707d8f5afaf2 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-0a92e1df-6177-4a88-8022-fb2b182b3ca6-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-0a184823-27c3-415c-9f9d-9778c3cb1150-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-0a184823-27c3-415c-9f9d-9778c3cb1150-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-quobyte-0a184823-27c3-415c-9f9d-9778c3cb1150" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-0a184823-27c3-415c-9f9d-9778c3cb1150" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[290c497f-2db2-40a7-9f9e-d68bfc795a5d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:23 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 Apr 09 16:54:23 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:23 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 1073741824" returned: 0 in 0.619s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:23 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 Apr 09 16:54:23 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:24 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150" returned: 0 in 0.609s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:24 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150 Apr 09 16:54:24 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-404af2a8-5bf7-4844-b929-f656dfd01781-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-404af2a8-5bf7-4844-b929-f656dfd01781-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:24 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583" returned: 0 in 0.471s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-quobyte-404af2a8-5bf7-4844-b929-f656dfd01781" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-404af2a8-5bf7-4844-b929-f656dfd01781" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Deleting offline snapshot 404af2a8-5bf7-4844-b929-f656dfd01781 of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] snapshot_file for this snap is: volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Attempting download of d01216e8-c5dc-4c96-8184-f8935064d568 ((None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}])) to volume 0e6a13eb-2522-4e89-9d2f-3135a5984583. {{(pid=82139) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1082970-e239-42cd-b532-15040803fbe7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac26e6-bd3a-4cea-867d-3210e3d42937]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_xky5qn9y {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:24 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 Apr 09 16:54:24 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:24 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_xky5qn9y Apr 09 16:54:24 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:24 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a184823-27c3-415c-9f9d-9778c3cb1150" returned: 0 in 0.496s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-0a184823-27c3-415c-9f9d-9778c3cb1150" released by "delete_volume" :: held 1.129s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Created reservations ['af2474b8-088a-4a5f-9de4-34628af3d385', 'b3c3a321-5773-4170-96b6-9932c0569efb', '0982592d-12a3-4344-a1c5-e39ce16d36b0', '5ff61088-42be-4d14-9934-ed1710605cad'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:24 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:24 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:25 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781" returned: 0 in 0.565s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[46692aa5-b3ef-46fa-b6a7-e2fba8073b2c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:25 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_xky5qn9y" returned: 0 in 0.566s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_xky5qn9y {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:25 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_xky5qn9y Apr 09 16:54:25 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:25 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:25 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:25 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.467s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:25 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Deleted volume successfully. Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e412bf67-9ed3-4b1e-b0c7-76eb8ebcae50 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-0a184823-27c3-415c-9f9d-9778c3cb1150-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:25 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.507s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:25 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_xky5qn9y" returned: 1 in 0.494s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_xky5qn9y' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2458eb2-ddb9-4aa0-bf8d-1ec5da8d6452]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:25 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 Apr 09 16:54:25 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:25 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD Apr 09 16:54:25 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-11f5b76b-2c1e-41f0-86cb-fc38a2051436-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-11f5b76b-2c1e-41f0-86cb-fc38a2051436-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-quobyte-11f5b76b-2c1e-41f0-86cb-fc38a2051436" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-11f5b76b-2c1e-41f0-86cb-fc38a2051436" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce3377e-42df-4729-82b6-6f31e4755b31]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:25 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 Apr 09 16:54:25 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:26 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781" returned: 0 in 0.546s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:26 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD" returned: 0 in 0.545s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] d01216e8-c5dc-4c96-8184-f8935064d568 was qcow2, converting to raw {{(pid=82139) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:26 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781 Apr 09 16:54:26 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:26 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 Apr 09 16:54:26 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:26 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436" returned: 0 in 0.518s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:26 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436 Apr 09 16:54:26 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:26 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.404af2a8-5bf7-4844-b929-f656dfd01781" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-404af2a8-5bf7-4844-b929-f656dfd01781" released by "_delete_snapshot" :: held 2.092s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" released by "delete_snapshot" :: held 2.110s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Created reservations ['2857d0b8-1a2a-48fa-baa7-8ef0a4bf51c8', 'a1bf9b5d-7739-4191-a72c-7b2095ab1998', '93e0c4b0-c693-412f-b4a2-9f1ad99f5b97', 'c676c759-0737-485d-876c-b95def3b8a68'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:26 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Delete snapshot completed successfully. Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4da164d-8d61-4ec0-80bd-281a88f921ed tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-404af2a8-5bf7-4844-b929-f656dfd01781-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:26 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-11f5b76b-2c1e-41f0-86cb-fc38a2051436" returned: 0 in 0.491s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-11f5b76b-2c1e-41f0-86cb-fc38a2051436" released by "delete_volume" :: held 1.042s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Created reservations ['559ba6a3-b74b-415a-99ea-5cf8977a1ccc', 'dd36d38f-0be4-4696-8613-53c09544a02d', '9027cae5-1b07-4635-8d6a-a17751ff452c', '069eee22-72f3-47ee-92a7-31d9ff459385'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:26 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:26 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:27 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583" returned: 0 in 0.997s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_o1fs_ej4devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:54:27 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Converted 112.00 MB image at 112.00 MB/s Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:27 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 1G Apr 09 16:54:27 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:27 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.458s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Deleted volume successfully. Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-26ce982d-b567-4c04-87c8-c373850cee91 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-11f5b76b-2c1e-41f0-86cb-fc38a2051436-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:27 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 1G" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38cecd-9aff-453d-88c0-31b5db1f1345]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:27 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 Apr 09 16:54:27 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Creating offline snapshot 657e07e8-75ac-4ca9-bb80-3be2718a66d4 of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[add4c758-41d9-497f-9230-24dd94d3ee68]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:27 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:27 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-quobyte-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16" acquired by "delete_volume" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[be022508-0951-4c60-9e15-cb8547ffc3d5]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:28 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 Apr 09 16:54:28 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:28 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583" returned: 0 in 0.728s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:28 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 Apr 09 16:54:28 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:28 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.847s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:28 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 1G Apr 09 16:54:28 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:28 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16" returned: 0 in 0.632s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:28 devstack sudo[86316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16 Apr 09 16:54:28 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:29 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583" returned: 1 in 0.653s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Downloaded image d01216e8-c5dc-4c96-8184-f8935064d568 ((None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}])) to volume 0e6a13eb-2522-4e89-9d2f-3135a5984583 successfully. {{(pid=82139) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Temporary image d01216e8-c5dc-4c96-8184-f8935064d568 for user a9da43e466184d59be1364649cd26a30 is deleted. {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Marking volume 0e6a13eb-2522-4e89-9d2f-3135a5984583 as bootable. {{(pid=82139) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Copying metadata from image d01216e8-c5dc-4c96-8184-f8935064d568 to 0e6a13eb-2522-4e89-9d2f-3135a5984583. {{(pid=82139) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Creating volume glance metadata for volume 0e6a13eb-2522-4e89-9d2f-3135a5984583 backed by image d01216e8-c5dc-4c96-8184-f8935064d568 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82139) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90dd7ed-c477-4a9a-abaf-0ff01f66fa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6a13eb-2522-4e89-9d2f-3135a5984583', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1487281-57ca-4fbd-9696-0a0718586052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:29 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Volume volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 (0e6a13eb-2522-4e89-9d2f-3135a5984583): created successfully Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1487281-57ca-4fbd-9696-0a0718586052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Flow 'volume_create_manager' (519c95b5-72bc-47f1-bec3-c4abd8c4153c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-546c18fb-d5d4-4768-8c5e-165e6f0ff134 tempest-VolumesImageMetadata-438176946 None] Created volume successfully. Apr 09 16:54:29 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16" returned: 0 in 0.599s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16" released by "delete_volume" :: held 1.269s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:29 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Created reservations ['2d478d1f-71a1-4fb5-8425-b256ebd20ce3', '8d8b97f6-d5e3-40df-b1a2-a1e46a37a320', 'e4a465a4-88cf-430b-bd7f-0c11f9f201c5', '2a0b8b8d-d83f-45f3-b010-9db67011c9c9'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 1G" returned: 0 in 0.708s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:29 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 Apr 09 16:54:29 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:29 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:29 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:29 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:29 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 is being set with open permissions: ugo+rw Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:29 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 Apr 09 16:54:29 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:29 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.511s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Deleted volume successfully. Apr 09 16:54:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7a4cf598-ddfb-4e1d-a29e-db82a53ba1ad tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-6ac70d29-5897-4e61-a5ed-0faf0a0d3a16-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-0a4081ab-40c4-4116-b579-0a1660bf64f8-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-0a4081ab-40c4-4116-b579-0a1660bf64f8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "cinder-quobyte-0a4081ab-40c4-4116-b579-0a1660bf64f8" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-0a4081ab-40c4-4116-b579-0a1660bf64f8" acquired by "delete_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:30 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4" returned: 0 in 0.523s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff7f3cb-6cb7-493c-ab2d-c30d5c6b1055]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.693s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eaea4207-086b-4a16-b621-1bd81b1a77c7 tempest-SnapshotsActionsTest-1811189476 None] Create snapshot completed successfully Apr 09 16:54:30 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 Apr 09 16:54:30 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Acquiring lock "cinder-0e6a13eb-2522-4e89-9d2f-3135a5984583-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Lock "cinder-0e6a13eb-2522-4e89-9d2f-3135a5984583-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Acquiring lock "cinder-quobyte-0e6a13eb-2522-4e89-9d2f-3135a5984583" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Lock "cinder-quobyte-0e6a13eb-2522-4e89-9d2f-3135a5984583" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f5a8d4-2b27-4d67-aebf-19b4f41704bc]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:30 devstack sudo[86362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 Apr 09 16:54:30 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-657e07e8-75ac-4ca9-bb80-3be2718a66d4-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-657e07e8-75ac-4ca9-bb80-3be2718a66d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-quobyte-657e07e8-75ac-4ca9-bb80-3be2718a66d4" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-657e07e8-75ac-4ca9-bb80-3be2718a66d4" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Deleting offline snapshot 657e07e8-75ac-4ca9-bb80-3be2718a66d4 of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] snapshot_file for this snap is: volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae44730-bf3f-4510-821f-fe438c5a32b1]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:31 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8" returned: 0 in 0.721s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:31 devstack sudo[86368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8 Apr 09 16:54:31 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:31 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 Apr 09 16:54:31 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:31 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583" returned: 0 in 0.674s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:31 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 Apr 09 16:54:31 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:31 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4081ab-40c4-4116-b579-0a1660bf64f8" returned: 0 in 0.513s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-quobyte-0a4081ab-40c4-4116-b579-0a1660bf64f8" released by "delete_volume" :: held 1.276s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Created reservations ['1342e45d-ab63-4dd7-94c8-c65e6933288e', '6d4b4dd9-e55e-45d6-b069-6977f615706f', '15a01772-e164-4c43-9871-f093e97c47f0', 'a3182084-6ff7-44b2-b076-95549f0261ad'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:31 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:31 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:31 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4" returned: 0 in 0.723s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb73b9-7854-4b8d-849d-9e9dde4cae38]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:31 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:31 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:31 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583" returned: 1 in 0.581s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:54:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:32 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583 Apr 09 16:54:32 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:32 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.501s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:32 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Deleted volume successfully. Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-892ad706-9751-4ad9-a4b9-84e5e8ee05a9 tempest-CreateVolumesFromImageTest-1814313989 None] Lock "cinder-0a4081ab-40c4-4116-b579-0a1660bf64f8-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:32 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.581s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:32 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 Apr 09 16:54:32 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:32 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e6a13eb-2522-4e89-9d2f-3135a5984583" returned: 0 in 0.534s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Lock "cinder-quobyte-0e6a13eb-2522-4e89-9d2f-3135a5984583" released by "delete_volume" :: held 1.831s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Created reservations ['540f80bb-a7d4-4fe6-a86a-fa5b7fe52ded', 'bf97fc89-d421-44c4-8b88-9c44cb38831c', 'd306d1e7-5748-4be4-91bb-4ae1797bfecb', '1f2b6747-e7ee-4e02-a8d8-0ef1426b2580'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:32 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:32 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:32 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4" returned: 0 in 0.564s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:33 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4 Apr 09 16:54:33 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:33 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.639s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:33 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Deleted volume successfully. Apr 09 16:54:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2508e82f-885f-45ce-b994-393edbbc906f tempest-VolumesImageMetadata-438176946 None] Lock "cinder-0e6a13eb-2522-4e89-9d2f-3135a5984583-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:33 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.657e07e8-75ac-4ca9-bb80-3be2718a66d4" returned: 0 in 0.595s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-657e07e8-75ac-4ca9-bb80-3be2718a66d4" released by "_delete_snapshot" :: held 2.546s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" released by "delete_snapshot" :: held 2.564s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:33 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Created reservations ['ca05abcb-bd6c-45a5-852f-903f268a0be9', 'f7f9fd40-c160-464d-93ac-da2cc86542a4', '0ffb6542-0053-41f6-aeda-32056e799d9a', 'ec268fd4-34a7-4a52-a5b7-4101fdf3713f'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Delete snapshot completed successfully. Apr 09 16:54:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f0561a8a-2bda-4976-b0b2-a579406f5eb8 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-657e07e8-75ac-4ca9-bb80-3be2718a66d4-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Creating offline snapshot c5be3776-251c-4bac-abee-e808df241e32 of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:54:34 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b00f823-ba80-41f9-bb1e-ed0bb285e450]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:34 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:34 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (323bafe9-a12f-479e-88a4-e0ae7f53d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1af44f9-dcb9-4c03-aed6-18f1e0a6c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1af44f9-dcb9-4c03-aed6-18f1e0a6c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160325822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea099f0-9a8b-4f8c-b587-2151f680cbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:35Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3de768-2817-4e72-84a8-c1f15bfdcf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3de768-2817-4e72-84a8-c1f15bfdcf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f610e-91a7-4a9e-b624-bb29218abdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f610e-91a7-4a9e-b624-bb29218abdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea099f0-9a8b-4f8c-b587-2151f680cbea', 'volume_name': 'volume-dea099f0-9a8b-4f8c-b587-2151f680cbea', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406d3f5b-ed9d-4922-b469-c0daf45c6306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406d3f5b-ed9d-4922-b469-c0daf45c6306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512130fc-a5ad-438d-9a9a-2973260dd59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume dea099f0-9a8b-4f8c-b587-2151f680cbea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea099f0-9a8b-4f8c-b587-2151f680cbea', 'volume_size': 1} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Flow 'volume_create_manager' (36070d87-c7c0-49db-b15d-0597fd37448e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c909b26-86a6-476d-b046-c84a35349f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.727s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c909b26-86a6-476d-b046-c84a35349f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1343265862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e269b5-d9b5-4c00-88e4-f93fd83b09fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba9b2fd3a2640c990e73cafc0996e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:35Z,use_quota=True,user_id='a158589ee18d4b57963f9c0fbc17d153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:35 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 1G Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3fcaa2-c5b5-46d2-bb2c-371b7797fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3fcaa2-c5b5-46d2-bb2c-371b7797fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ff6fe3-92fd-4341-b587-2acc60ef9f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ff6fe3-92fd-4341-b587-2acc60ef9f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e269b5-d9b5-4c00-88e4-f93fd83b09fe', 'volume_name': 'volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253c4515-2df3-4ff4-b492-d698622b633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253c4515-2df3-4ff4-b492-d698622b633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b38586-a373-4810-b06a-47655935bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:35 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Volume a3e269b5-d9b5-4c00-88e4-f93fd83b09fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe', 'volume_size': 1} Apr 09 16:54:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:36 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 1G" returned: 0 in 0.588s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:36 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 Apr 09 16:54:36 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:36 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32" returned: 0 in 0.613s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:36 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 is being set with open permissions: ugo+rw Apr 09 16:54:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:36 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 Apr 09 16:54:36 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:37 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32" returned: 0 in 0.565s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.014s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160325822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea099f0-9a8b-4f8c-b587-2151f680cbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:35Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Creating volume dea099f0-9a8b-4f8c-b587-2151f680cbea {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:37 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:37 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea 1073741824 Apr 09 16:54:37 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:37 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f0f19659-7d96-4dec-8470-000ec728dc55 tempest-SnapshotsActionsTest-1811189476 None] Create snapshot completed successfully Apr 09 16:54:37 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea 1073741824" returned: 0 in 0.548s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:37 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea Apr 09 16:54:37 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-c5be3776-251c-4bac-abee-e808df241e32-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-c5be3776-251c-4bac-abee-e808df241e32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-quobyte-c5be3776-251c-4bac-abee-e808df241e32" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-c5be3776-251c-4bac-abee-e808df241e32" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Deleting offline snapshot c5be3776-251c-4bac-abee-e808df241e32 of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] snapshot_file for this snap is: volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93b6afa-6218-4bb8-815a-7fefeb6a8ec3]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:38 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 Apr 09 16:54:38 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:38 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea" returned: 0 in 0.465s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.789s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1343265862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e269b5-d9b5-4c00-88e4-f93fd83b09fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba9b2fd3a2640c990e73cafc0996e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:35Z,use_quota=True,user_id='a158589ee18d4b57963f9c0fbc17d153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Creating volume a3e269b5-d9b5-4c00-88e4-f93fd83b09fe {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:38 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512130fc-a5ad-438d-9a9a-2973260dd59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea099f0-9a8b-4f8c-b587-2151f680cbea', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:38 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe 1073741824 Apr 09 16:54:38 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87510e2a-64f0-4c3b-8d25-c6267ab074af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:38 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume volume-dea099f0-9a8b-4f8c-b587-2151f680cbea (dea099f0-9a8b-4f8c-b587-2151f680cbea): created successfully Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87510e2a-64f0-4c3b-8d25-c6267ab074af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (323bafe9-a12f-479e-88a4-e0ae7f53d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:38 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7bdf4397-b7ae-4e94-9c1f-28c536ca97a4 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created volume successfully. Apr 09 16:54:38 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32" returned: 0 in 0.570s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c66d00-ed33-4ee4-b56c-c19826162825]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:38 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:38 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:39 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe 1073741824" returned: 0 in 0.621s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:39 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe Apr 09 16:54:39 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:39 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.693s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:39 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 Apr 09 16:54:39 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:39 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" returned: 0 in 0.554s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.813s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b38586-a373-4810-b06a-47655935bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c15eef-32e4-4505-a1eb-1cc479267c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Creating offline snapshot 85b65225-e1e6-4c3f-a534-a61ae22000ea of volume dea099f0-9a8b-4f8c-b587-2151f680cbea {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f0a6e3-a071-40ca-85dd-f9489006e8a9]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Volume volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe (a3e269b5-d9b5-4c00-88e4-f93fd83b09fe): created successfully Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c15eef-32e4-4505-a1eb-1cc479267c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Flow 'volume_create_manager' (36070d87-c7c0-49db-b15d-0597fd37448e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:39 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a9557b5e-048a-4900-a31b-50bbd082c4ec tempest-SnapshotMetadataTestJSON-405329229 None] Created volume successfully. Apr 09 16:54:39 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea Apr 09 16:54:39 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:39 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32" returned: 0 in 0.661s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:39 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32 Apr 09 16:54:39 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:40 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.c5be3776-251c-4bac-abee-e808df241e32" returned: 0 in 0.505s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-c5be3776-251c-4bac-abee-e808df241e32" released by "_delete_snapshot" :: held 2.483s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" released by "delete_snapshot" :: held 2.496s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:40 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea" returned: 0 in 0.875s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:40 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea 1G Apr 09 16:54:40 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:40 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Created reservations ['6e2ced6b-a53f-41dd-b3d7-4e6cbb3c141f', '5930da9d-66e2-4f03-863e-89711c4ae57a', 'b715820a-e5ff-4bde-ad8d-383f56a82bce', 'f91efb07-e31c-4d45-b39e-96795c3cdd40'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:40 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Delete snapshot completed successfully. Apr 09 16:54:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d28cb1e8-57aa-4654-81c1-e9a258faa387 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-c5be3776-251c-4bac-abee-e808df241e32-delete_snapshot" released by "delete_snapshot" :: held 2.618s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:41 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea 1G" returned: 0 in 0.634s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea099f0-9a8b-4f8c-b587-2151f680cbea -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:41 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea099f0-9a8b-4f8c-b587-2151f680cbea -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea Apr 09 16:54:41 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:41 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea099f0-9a8b-4f8c-b587-2151f680cbea -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea" returned: 0 in 0.487s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:41 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea is being set with open permissions: ugo+rw Apr 09 16:54:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:41 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea Apr 09 16:54:41 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:42 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea" returned: 0 in 0.394s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:42 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.info Apr 09 16:54:42 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:42 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.info" returned: 0 in 0.510s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:42 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.info is being set with open permissions: ugo+rw Apr 09 16:54:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:42 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.info Apr 09 16:54:42 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:42 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.info" returned: 0 in 0.439s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.414s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.835s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Creating offline snapshot 171b6e7c-1a30-46d1-991a-ae2a5d18dcaf of volume a3e269b5-d9b5-4c00-88e4-f93fd83b09fe {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:54:43 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-72ea6271-df81-457d-843a-064cf11addae tempest-CreateVolumesFromSnapshotTest-806553478 None] Create snapshot completed successfully Apr 09 16:54:43 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398bacf-45d5-4beb-b368-07b769660a37]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:43 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe Apr 09 16:54:43 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:43 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" returned: 0 in 0.534s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:43 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf 1G Apr 09 16:54:43 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:44 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf 1G" returned: 0 in 0.578s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:44 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf Apr 09 16:54:44 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (997b32d0-24e2-4bc0-ab56-380f6c4e2079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76e7d22-e61c-49c5-bdf6-2fdd7c3101c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76e7d22-e61c-49c5-bdf6-2fdd7c3101c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1329104864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187b72ef-c913-4640-9cc3-1cb11b07a396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:44Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f972dd88-6698-45d2-9ad6-24e17c1d0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f972dd88-6698-45d2-9ad6-24e17c1d0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17c6027-e156-45b4-a771-17d299428780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17c6027-e156-45b4-a771-17d299428780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187b72ef-c913-4640-9cc3-1cb11b07a396', 'volume_name': 'volume-187b72ef-c913-4640-9cc3-1cb11b07a396', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c914e38b-7c12-496d-b77e-8b263394b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c914e38b-7c12-496d-b77e-8b263394b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a46adb-d778-4001-9c3b-ccbd8924b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume 187b72ef-c913-4640-9cc3-1cb11b07a396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187b72ef-c913-4640-9cc3-1cb11b07a396', 'volume_size': 1} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (3c4693e4-37bf-4444-ab34-7dcfc2a823bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354485e8-91d6-4adb-b7fc-2a1267428e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354485e8-91d6-4adb-b7fc-2a1267428e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-978591046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03828e86-589b-4e9c-9272-457c166994b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:45Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1848203c-32cd-44ff-bb03-3211dfea17aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1848203c-32cd-44ff-bb03-3211dfea17aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c056164-4d79-40dd-acad-9c990595507e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c056164-4d79-40dd-acad-9c990595507e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03828e86-589b-4e9c-9272-457c166994b6', 'volume_name': 'volume-03828e86-589b-4e9c-9272-457c166994b6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f22b1d-2a76-434f-a671-fd7a5bd7de94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f22b1d-2a76-434f-a671-fd7a5bd7de94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34f7913-76bd-4c26-a5c0-3cde6a349422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:44 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume 03828e86-589b-4e9c-9272-457c166994b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03828e86-589b-4e9c-9272-457c166994b6', 'volume_size': 1} Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:44 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf" returned: 0 in 0.805s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:44 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf is being set with open permissions: ugo+rw Apr 09 16:54:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:45 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf Apr 09 16:54:45 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (5fe48e7b-4075-4e8b-b05e-d3e9ee271281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7070b5-a200-4f21-9361-614dbdd7c206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7070b5-a200-4f21-9361-614dbdd7c206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741059395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f529461-e652-48f6-be70-8c8fe49f6f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:45Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4caa26-be9c-409d-9248-df8c965baa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4caa26-be9c-409d-9248-df8c965baa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff29a2d6-ac1d-437b-96ba-d56e2872ab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff29a2d6-ac1d-437b-96ba-d56e2872ab3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f529461-e652-48f6-be70-8c8fe49f6f19', 'volume_name': 'volume-7f529461-e652-48f6-be70-8c8fe49f6f19', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7073649-3646-4c6f-b732-bc0f528f1438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7073649-3646-4c6f-b732-bc0f528f1438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e027e9-c255-4b30-97a0-b25adf721c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume 7f529461-e652-48f6-be70-8c8fe49f6f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f529461-e652-48f6-be70-8c8fe49f6f19', 'volume_size': 1} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (aa62e788-5463-450f-aba6-5179ff563f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eec2f9d-31ab-4310-ba45-e0ec397e431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eec2f9d-31ab-4310-ba45-e0ec397e431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093604584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18df779-f1e4-4ffe-a738-baeb6fe18da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:45Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa177cc-ba01-4731-9815-ea1ed99d39e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa177cc-ba01-4731-9815-ea1ed99d39e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbca378-5042-4c83-ade3-a730e6c1e517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbca378-5042-4c83-ade3-a730e6c1e517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18df779-f1e4-4ffe-a738-baeb6fe18da0', 'volume_name': 'volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0ffb8f-f1ad-45db-bf10-30ee61f8ba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0ffb8f-f1ad-45db-bf10-30ee61f8ba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6beb858c-28bb-4ce7-9c6f-38f8dca53199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume d18df779-f1e4-4ffe-a738-baeb6fe18da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0', 'volume_size': 1} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (ad49c78e-d632-4894-8e2b-0f2a1eee6e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9930f6c9-0dc0-45f6-9efd-60bb1921c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9930f6c9-0dc0-45f6-9efd-60bb1921c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439928549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:46Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2bc86c-fa0c-4c19-8061-8ad993202ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2bc86c-fa0c-4c19-8061-8ad993202ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e70b3b-0e77-4684-a77c-a0f28b3fe7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e70b3b-0e77-4684-a77c-a0f28b3fe7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b', 'volume_name': 'volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4672774-9085-4ab1-b194-60648abe672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4672774-9085-4ab1-b194-60648abe672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:45 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc9f5dc-a92b-4cb9-8698-57212b20634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:45 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume 10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b', 'volume_size': 1} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf" returned: 0 in 0.707s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:45 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.info Apr 09 16:54:45 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:46 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.info" returned: 0 in 0.441s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:46 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.info is being set with open permissions: ugo+rw Apr 09 16:54:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:46 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.info Apr 09 16:54:46 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:46 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.info" returned: 0 in 0.417s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.549s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.165s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Creating offline snapshot 5113ad18-77f5-447d-bb24-7eddb1e4d49f of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:54:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d69c0d-99f7-4f1a-99be-98256250de4f]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:46 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-88c4c419-652f-4d43-869f-c0a0206d78f6 tempest-SnapshotMetadataTestJSON-405329229 None] Create snapshot completed successfully Apr 09 16:54:46 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:46 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:47 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.507s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:47 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f 1G Apr 09 16:54:47 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:47 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f 1G" returned: 0 in 0.573s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:47 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f Apr 09 16:54:47 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "cinder-171b6e7c-1a30-46d1-991a-ae2a5d18dcaf-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-171b6e7c-1a30-46d1-991a-ae2a5d18dcaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "cinder-quobyte-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-quobyte-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "cinder-quobyte-171b6e7c-1a30-46d1-991a-ae2a5d18dcaf" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-quobyte-171b6e7c-1a30-46d1-991a-ae2a5d18dcaf" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Deleting offline snapshot 171b6e7c-1a30-46d1-991a-ae2a5d18dcaf of volume a3e269b5-d9b5-4c00-88e4-f93fd83b09fe {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] snapshot_file for this snap is: volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe6a90b-de65-4d07-9ba0-b6b2a43a87d1]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:48 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf Apr 09 16:54:48 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:48 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f" returned: 0 in 0.550s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:48 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f is being set with open permissions: ugo+rw Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:48 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f Apr 09 16:54:48 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:48 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf" returned: 0 in 0.529s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f0705d-b9ad-4fe7-9d62-117fe7b83d97]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:48 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe Apr 09 16:54:48 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:48 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f" returned: 0 in 0.445s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.267s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1329104864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187b72ef-c913-4640-9cc3-1cb11b07a396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:44Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Creating volume 187b72ef-c913-4640-9cc3-1cb11b07a396 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:48 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:48 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 1073741824 Apr 09 16:54:48 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:48 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1b46a7e8-10ae-4bc9-a465-35be5f8776e5 tempest-SnapshotsActionsTest-1811189476 None] Create snapshot completed successfully Apr 09 16:54:49 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:49 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf Apr 09 16:54:49 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:49 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 1073741824" returned: 0 in 0.593s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:49 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 Apr 09 16:54:49 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-5113ad18-77f5-447d-bb24-7eddb1e4d49f-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:50 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-5113ad18-77f5-447d-bb24-7eddb1e4d49f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf" returned: 0 in 0.894s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" acquired by "delete_snapshot" :: waited 0.048s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Acquiring lock "cinder-quobyte-5113ad18-77f5-447d-bb24-7eddb1e4d49f" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:50 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396" returned: 0 in 0.743s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:50 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf Apr 09 16:54:50 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.310s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-978591046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03828e86-589b-4e9c-9272-457c166994b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:45Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Creating volume 03828e86-589b-4e9c-9272-457c166994b6 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:50 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-5113ad18-77f5-447d-bb24-7eddb1e4d49f" acquired by "_delete_snapshot" :: waited 0.087s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Deleting offline snapshot 5113ad18-77f5-447d-bb24-7eddb1e4d49f of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:54:50 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 1073741824 Apr 09 16:54:50 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] snapshot_file for this snap is: volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a46adb-d778-4001-9c3b-ccbd8924b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187b72ef-c913-4640-9cc3-1cb11b07a396', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82308d5-a44f-42f7-b6ff-e697ff9079c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b4151-b24e-44a7-890b-dc278ae3f6a2]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:50 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume volume-187b72ef-c913-4640-9cc3-1cb11b07a396 (187b72ef-c913-4640-9cc3-1cb11b07a396): created successfully Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82308d5-a44f-42f7-b6ff-e697ff9079c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (997b32d0-24e2-4bc0-ab56-380f6c4e2079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:50 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4e540008-e2e0-42fa-93e1-1c29d0c782c6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created volume successfully. Apr 09 16:54:50 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f Apr 09 16:54:50 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:50 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe.171b6e7c-1a30-46d1-991a-ae2a5d18dcaf" returned: 0 in 0.718s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-quobyte-171b6e7c-1a30-46d1-991a-ae2a5d18dcaf" released by "_delete_snapshot" :: held 2.773s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-quobyte-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" released by "delete_snapshot" :: held 2.787s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Created reservations ['2f08caf9-cbd8-47e7-b142-d175bda45933', '710cfef9-b1a3-40e3-b5d6-cf4f592de6f1', 'fbd2acb5-4391-47d1-bd88-96274308ae60', '26be6f3d-e5cc-4edf-bbac-5b78a24214f4'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:50 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Delete snapshot completed successfully. Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5a5cd38d-7ea0-4b07-8272-d069e28e6133 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-171b6e7c-1a30-46d1-991a-ae2a5d18dcaf-delete_snapshot" released by "delete_snapshot" :: held 2.887s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:50 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f" returned: 0 in 0.639s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be7c470-cb91-4290-904c-12bf38cf747c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:51 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:51 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:51 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 1073741824" returned: 0 in 0.942s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:51 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 Apr 09 16:54:51 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "cinder-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "cinder-quobyte-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-quobyte-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf58d22-589b-4cbd-bef5-0957c46d9d80]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:51 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe Apr 09 16:54:51 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:51 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.868s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:51 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f Apr 09 16:54:51 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:52 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6" returned: 0 in 1.134s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.197s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741059395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f529461-e652-48f6-be70-8c8fe49f6f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:45Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Creating volume 7f529461-e652-48f6-be70-8c8fe49f6f19 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:52 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34f7913-76bd-4c26-a5c0-3cde6a349422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03828e86-589b-4e9c-9272-457c166994b6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5512fb-9fd2-462d-b43b-650104146d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:52 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 1073741824 Apr 09 16:54:52 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:52 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume volume-03828e86-589b-4e9c-9272-457c166994b6 (03828e86-589b-4e9c-9272-457c166994b6): created successfully Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5512fb-9fd2-462d-b43b-650104146d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (3c4693e4-37bf-4444-ab34-7dcfc2a823bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-67d14697-cdd5-455f-bff1-9cdf3679d30b tempest-CreateVolumesFromSnapshotTest-806553478 None] Created volume successfully. Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Flow 'volume_create_manager' (94fc5bf5-834f-4aa5-9115-6ae3fb85fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed99c1bf-8a81-4b78-abd7-7ac0c2a6493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed99c1bf-8a81-4b78-abd7-7ac0c2a6493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1167554391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec74bee-b61a-42b9-ab11-e02eff9fa2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e849f6430f4f7fb0021952244f6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:52Z,use_quota=True,user_id='5812fa3a9a514023ae7422284e37ba77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea17e7d9-8224-498c-aa8f-4e9daa531dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea17e7d9-8224-498c-aa8f-4e9daa531dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:52 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7524358-f1b8-4e82-bd0e-61273daaee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7524358-f1b8-4e82-bd0e-61273daaee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec74bee-b61a-42b9-ab11-e02eff9fa2a0', 'volume_name': 'volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ad52ca-b5ff-4819-9adf-9b8a837dc108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ad52ca-b5ff-4819-9adf-9b8a837dc108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a477e3-9f6f-46ff-b089-d1e8ebbb749d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:52 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Volume 3ec74bee-b61a-42b9-ab11-e02eff9fa2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0', 'volume_size': 1} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f" returned: 0 in 0.880s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:52 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f Apr 09 16:54:52 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:52 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" returned: 0 in 1.320s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:52 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe Apr 09 16:54:52 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:53 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:53 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.5113ad18-77f5-447d-bb24-7eddb1e4d49f" returned: 0 in 0.658s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 1073741824" returned: 0 in 1.059s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-5113ad18-77f5-447d-bb24-7eddb1e4d49f" released by "_delete_snapshot" :: held 3.185s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" released by "delete_snapshot" :: held 3.293s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:53 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" returned: 0 in 0.678s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:53 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 Apr 09 16:54:53 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-quobyte-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe" released by "delete_volume" :: held 2.059s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Created reservations ['e1f043d0-e9f4-4b05-aed8-b53617b07cf3', 'f95e4e12-c730-4a56-891e-3cbd931e7c55', '5044d1a2-44f1-45b2-a0de-3f8470c5201e', '208b39dd-3cf0-49c8-89bf-b5ef307fb2ce'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Created reservations ['d40705af-4c01-4162-8b61-cb8e319f2691', 'a9bb9e8c-8808-466b-8a00-d2a9c71fb504', '79cc9135-f82d-4c76-be70-22738814deda', 'aead168a-f5eb-4359-a8f3-bb09c900a76d'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:53 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Delete snapshot completed successfully. Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c78571-0d8d-4ce6-bffe-fb30cef7c584 tempest-SnapshotsActionsTest-189224809 None] Lock "cinder-5113ad18-77f5-447d-bb24-7eddb1e4d49f-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:53 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:54:53 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:53 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19" returned: 0 in 0.543s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.600s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093604584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18df779-f1e4-4ffe-a738-baeb6fe18da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:45Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Creating volume d18df779-f1e4-4ffe-a738-baeb6fe18da0 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:53 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e027e9-c255-4b30-97a0-b25adf721c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f529461-e652-48f6-be70-8c8fe49f6f19', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78801c54-9681-442d-92dd-d3a7bcb97c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:54 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume volume-7f529461-e652-48f6-be70-8c8fe49f6f19 (7f529461-e652-48f6-be70-8c8fe49f6f19): created successfully Apr 09 16:54:54 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 1073741824 Apr 09 16:54:54 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78801c54-9681-442d-92dd-d3a7bcb97c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (5fe48e7b-4075-4e8b-b05e-d3e9ee271281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c921ae72-60a8-4d1d-952c-9125b60aacb8 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created volume successfully. Apr 09 16:54:54 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.864s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:54:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Deleted volume successfully. Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d893046b-545f-452b-a6f7-e7674d76e0a6 tempest-SnapshotMetadataTestJSON-405329229 None] Lock "cinder-a3e269b5-d9b5-4c00-88e4-f93fd83b09fe-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "cinder-efc14f7c-de57-4022-a7ae-61c15e07bda5-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-efc14f7c-de57-4022-a7ae-61c15e07bda5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "cinder-quobyte-efc14f7c-de57-4022-a7ae-61c15e07bda5" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-quobyte-efc14f7c-de57-4022-a7ae-61c15e07bda5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Deleting offline snapshot efc14f7c-de57-4022-a7ae-61c15e07bda5 of volume 3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] snapshot_file for this snap is: volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e677d-9396-4344-8f1b-3f18ff362633]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:55 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 1073741824" returned: 0 in 1.184s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:55 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:55 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:55 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 Apr 09 16:54:55 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:55 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0" returned: 0 in 0.576s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.094s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439928549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2045caa0c6d45c1b1e380edabac7341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:46Z,use_quota=True,user_id='558a93be5d45469bb48cb0b1e19ba1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Creating volume 10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:55 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:55 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b 1073741824 Apr 09 16:54:55 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6beb858c-28bb-4ce7-9c6f-38f8dca53199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d8f8d0-5e29-49dc-9c15-ed46d23a33b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:55 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 (d18df779-f1e4-4ffe-a738-baeb6fe18da0): created successfully Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d8f8d0-5e29-49dc-9c15-ed46d23a33b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (aa62e788-5463-450f-aba6-5179ff563f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:55 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ad749cd0-b9ee-4f7b-8ef3-dc5df0d09faf tempest-CreateVolumesFromSnapshotTest-806553478 None] Created volume successfully. Apr 09 16:54:55 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.903s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3032058c-b8de-4644-b4b9-e8830cd21c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:54:56 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3290186f-e00a-4c7b-a8d2-21a70332c42b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:56 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a Apr 09 16:54:56 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:56 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b 1073741824" returned: 0 in 0.808s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:56 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b Apr 09 16:54:56 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:56 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a" returned: 0 in 0.687s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:56 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:56 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:57 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b" returned: 0 in 0.646s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.574s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1167554391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec74bee-b61a-42b9-ab11-e02eff9fa2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e849f6430f4f7fb0021952244f6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:54:52Z,use_quota=True,user_id='5812fa3a9a514023ae7422284e37ba77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Creating volume 3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:54:57 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc9f5dc-a92b-4cb9-8698-57212b20634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f66598-c4bb-4cad-bbdc-62bb80e1e581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:57 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Volume volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b (10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b): created successfully Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f66598-c4bb-4cad-bbdc-62bb80e1e581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:57 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 1073741824 Apr 09 16:54:57 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Flow 'volume_create_manager' (ad49c78e-d632-4894-8e2b-0f2a1eee6e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:57 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ee4d4a79-857e-4bb5-bcf7-980d2a74c50e tempest-CreateVolumesFromSnapshotTest-806553478 None] Created volume successfully. Apr 09 16:54:57 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.718s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:57 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5 Apr 09 16:54:57 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-quobyte-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf293c1-46c2-4a0e-9084-fa93c080027a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:58 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 1073741824" returned: 0 in 0.875s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:58 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 Apr 09 16:54:58 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:58 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a.efc14f7c-de57-4022-a7ae-61c15e07bda5" returned: 0 in 0.883s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:58 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b Apr 09 16:54:58 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-quobyte-efc14f7c-de57-4022-a7ae-61c15e07bda5" released by "_delete_snapshot" :: held 3.281s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" released by "delete_snapshot" :: held 3.329s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Created reservations ['1934c1d7-449e-4d4d-a14b-0f0d1ce7ca8e', '80e77db1-70ca-4915-840b-e9b116822ef7', 'be05b2e5-5dc7-42f1-827a-23827a206bf3', '7297d650-cfbb-4b8a-8d19-222423b560ff'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:54:58 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Delete snapshot completed successfully. Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-80868aa5-e450-445a-a213-57194e812a88 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-efc14f7c-de57-4022-a7ae-61c15e07bda5-delete_snapshot" released by "delete_snapshot" :: held 3.537s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:58 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0" returned: 0 in 0.694s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a477e3-9f6f-46ff-b089-d1e8ebbb749d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd746e4e-f1c0-40d0-8d98-3f883cd25ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:54:58 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Volume volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 (3ec74bee-b61a-42b9-ab11-e02eff9fa2a0): created successfully Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd746e4e-f1c0-40d0-8d98-3f883cd25ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Flow 'volume_create_manager' (94fc5bf5-834f-4aa5-9115-6ae3fb85fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:54:58 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-427fb62d-07df-4ac5-80ab-a4662b303f05 tempest-ServerRescueNegativeTestJSON-1470487662 None] Created volume successfully. Apr 09 16:54:58 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b" returned: 0 in 0.855s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:59 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b Apr 09 16:54:59 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "cinder-3032058c-b8de-4644-b4b9-e8830cd21c7a-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-3032058c-b8de-4644-b4b9-e8830cd21c7a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c227c20b-43ac-40c0-9553-d4a59d78e67a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:54:59 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a Apr 09 16:54:59 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:54:59 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b" returned: 0 in 0.873s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b" released by "delete_volume" :: held 1.764s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:54:59 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created reservations ['dabb630b-1f06-48d7-a19e-1ff837602a47', '365f59cf-8a86-49f1-aaa0-56561c6532e6', '2de8c54a-ae3c-48ed-90a9-f918e9cce85f', '293d8b7b-a28a-4ea1-94af-251930c2d770'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:00 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:00 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-d18df779-f1e4-4ffe-a738-baeb6fe18da0-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-d18df779-f1e4-4ffe-a738-baeb6fe18da0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-quobyte-d18df779-f1e4-4ffe-a738-baeb6fe18da0" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-d18df779-f1e4-4ffe-a738-baeb6fe18da0" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34ddeb-8e89-4f86-93de-36973871cc4c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:00 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a" returned: 0 in 1.132s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:00 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 Apr 09 16:55:00 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:00 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a Apr 09 16:55:00 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:01 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 1.062s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:01 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Deleted volume successfully. Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64462559-8eb5-44fb-aed0-d6e4b7c4f0c9 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-10fe8ce7-ab98-45ba-9fa3-e8cd4750e12b-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:01 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3032058c-b8de-4644-b4b9-e8830cd21c7a" returned: 0 in 0.970s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:01 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0" returned: 0 in 1.184s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-quobyte-3032058c-b8de-4644-b4b9-e8830cd21c7a" released by "delete_volume" :: held 2.262s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:01 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0 Apr 09 16:55:01 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Created reservations ['f70c7e77-d7ba-4995-aafe-a8da0ed69e90', '19969afe-add3-460d-93bf-94eb26654273', '08e63d57-3cfa-4d85-ae41-cd405c7edfeb', 'e35159c2-6a32-4faa-98bb-b0483139bf45'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:02 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:02 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:02 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.583s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Deleted volume successfully. Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6c5bc009-3fcc-488a-b468-fbc3d6dc6d02 tempest-SnapshotsActionsTest-1811189476 None] Lock "cinder-3032058c-b8de-4644-b4b9-e8830cd21c7a-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:02 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d18df779-f1e4-4ffe-a738-baeb6fe18da0" returned: 0 in 0.865s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-d18df779-f1e4-4ffe-a738-baeb6fe18da0" released by "delete_volume" :: held 2.160s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created reservations ['90516442-915e-4818-ba60-de7a91e558f8', 'fcc0e5c6-5c08-49f6-80e4-50510827864c', '58d1fade-e767-43d1-b9d9-bce1a4a2a151', '0b030ab4-87fe-4a2e-8476-fc82eb1895df'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:02 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:02 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:03 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.655s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Deleted volume successfully. Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5047e05-afb3-44cf-8046-798d5d39e347 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-d18df779-f1e4-4ffe-a738-baeb6fe18da0-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-7f529461-e652-48f6-be70-8c8fe49f6f19-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-7f529461-e652-48f6-be70-8c8fe49f6f19-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-quobyte-7f529461-e652-48f6-be70-8c8fe49f6f19" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-7f529461-e652-48f6-be70-8c8fe49f6f19" acquired by "delete_volume" :: waited 0.024s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb92f4d8-438f-4c0c-ab32-e5c548842e9e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:03 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 Apr 09 16:55:03 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:04 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19" returned: 0 in 0.841s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:04 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19 Apr 09 16:55:04 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:05 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7f529461-e652-48f6-be70-8c8fe49f6f19" returned: 0 in 0.617s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-7f529461-e652-48f6-be70-8c8fe49f6f19" released by "delete_volume" :: held 1.524s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created reservations ['46f7c204-c7b2-4c18-8c96-340c148bae96', '9cad3329-34ca-4ff9-bb16-435d245b18ac', 'bcd81237-39e9-45a5-b829-a6e04865ae2b', 'd0bfbee3-4faf-406f-a2b5-b8169a1af243'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:05 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:05 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-03828e86-589b-4e9c-9272-457c166994b6-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-03828e86-589b-4e9c-9272-457c166994b6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-quobyte-03828e86-589b-4e9c-9272-457c166994b6" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-03828e86-589b-4e9c-9272-457c166994b6" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[535a9826-3843-4113-b18b-d181565f92fb]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:06 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 Apr 09 16:55:06 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:06 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 1.008s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Deleted volume successfully. Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dd200c19-ffed-4260-b8ad-e29461088121 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-7f529461-e652-48f6-be70-8c8fe49f6f19-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:06 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6" returned: 0 in 0.770s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:06 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6 Apr 09 16:55:06 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:07 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-03828e86-589b-4e9c-9272-457c166994b6" returned: 0 in 0.823s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-03828e86-589b-4e9c-9272-457c166994b6" released by "delete_volume" :: held 1.625s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created reservations ['54952166-14ee-4be3-843c-f7e0b6a0b0c3', '16da53e4-e4f7-409c-988f-4da401977c2a', '6732df26-2fb1-493d-b2d6-9dee715c40cf', 'dc719696-5f22-407f-8bcb-57be8e331bf8'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:07 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:07 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-187b72ef-c913-4640-9cc3-1cb11b07a396-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-187b72ef-c913-4640-9cc3-1cb11b07a396-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-quobyte-187b72ef-c913-4640-9cc3-1cb11b07a396" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-187b72ef-c913-4640-9cc3-1cb11b07a396" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[18518478-3abd-46c0-8240-f9d74a82c1ae]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:08 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.916s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:08 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Deleted volume successfully. Apr 09 16:55:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8f639ee-2427-4dde-9420-028ec05575f5 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-03828e86-589b-4e9c-9272-457c166994b6-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:08 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 Apr 09 16:55:08 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:09 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396" returned: 0 in 0.978s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:09 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396 Apr 09 16:55:09 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Flow 'volume_create_manager' (5cba930d-2ad8-417b-b620-e87d8c859ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad61e0a-acc4-4c20-9bed-e5125cf3ad86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad61e0a-acc4-4c20-9bed-e5125cf3ad86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-46116222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76946907-fed0-4dbe-a078-9d7ff68d56af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b8d77fc274077bd30da1a4253778e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:10Z,use_quota=True,user_id='15c27eb301de4520be612f11d756e96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebfed72-f061-4088-91a1-9bcd4d461dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebfed72-f061-4088-91a1-9bcd4d461dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c859348-145c-4baf-a4d2-0d7613979af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c859348-145c-4baf-a4d2-0d7613979af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76946907-fed0-4dbe-a078-9d7ff68d56af', 'volume_name': 'volume-76946907-fed0-4dbe-a078-9d7ff68d56af', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f074da9-89cf-4da9-9aff-2f48847ae479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f074da9-89cf-4da9-9aff-2f48847ae479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6311412e-746a-4aa0-ba58-a3991eefe280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:09 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Volume 76946907-fed0-4dbe-a078-9d7ff68d56af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76946907-fed0-4dbe-a078-9d7ff68d56af', 'volume_size': 1} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-46116222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76946907-fed0-4dbe-a078-9d7ff68d56af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02b8d77fc274077bd30da1a4253778e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:10Z,use_quota=True,user_id='15c27eb301de4520be612f11d756e96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Creating volume 76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:55:09 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:55:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:09 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af 1073741824 Apr 09 16:55:09 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:10 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-187b72ef-c913-4640-9cc3-1cb11b07a396" returned: 0 in 1.198s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:10 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-187b72ef-c913-4640-9cc3-1cb11b07a396" released by "delete_volume" :: held 2.225s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:10 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created reservations ['530b98d4-6b69-4c72-9b9e-7885efe0fcbd', '34ccd590-35b1-41c5-a0ac-624b8eb95346', '4c4a331a-1895-4e5a-9547-b07d6109a092', 'bdea7ddd-37c1-4742-b101-289e8948299b'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:10 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af 1073741824" returned: 0 in 1.055s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:10 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:11 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:11 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:11 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:55:11 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:11 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.712s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:11 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:11 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Deleted volume successfully. Apr 09 16:55:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-94b6d632-f537-450d-bd58-b1259e2ddc71 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-187b72ef-c913-4640-9cc3-1cb11b07a396-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-85b65225-e1e6-4c3f-a534-a61ae22000ea-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-85b65225-e1e6-4c3f-a534-a61ae22000ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-quobyte-dea099f0-9a8b-4f8c-b587-2151f680cbea" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-dea099f0-9a8b-4f8c-b587-2151f680cbea" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-quobyte-85b65225-e1e6-4c3f-a534-a61ae22000ea" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-85b65225-e1e6-4c3f-a534-a61ae22000ea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Deleting offline snapshot 85b65225-e1e6-4c3f-a534-a61ae22000ea of volume dea099f0-9a8b-4f8c-b587-2151f680cbea {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] snapshot_file for this snap is: volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72e8b15-4194-44ff-8e67-3db5359a9035]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:12 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 1.140s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6311412e-746a-4aa0-ba58-a3991eefe280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76946907-fed0-4dbe-a078-9d7ff68d56af', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69407e4-56e2-4232-8fca-ff3aa24d0acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Volume volume-76946907-fed0-4dbe-a078-9d7ff68d56af (76946907-fed0-4dbe-a078-9d7ff68d56af): created successfully Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69407e4-56e2-4232-8fca-ff3aa24d0acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:12 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Flow 'volume_create_manager' (5cba930d-2ad8-417b-b620-e87d8c859ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:12 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:12 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-162d4b05-7868-488e-a48e-cd69be42a6d2 tempest-VolumesActionsTest-188656524 None] Created volume successfully. Apr 09 16:55:12 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea" returned: 0 in 0.634s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dea099f0-9a8b-4f8c-b587-2151f680cbea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abfba0d-2593-44a3-93f5-d00288b0c2f4]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:12 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea Apr 09 16:55:12 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:13 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea" returned: 0 in 0.954s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:13 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea Apr 09 16:55:13 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:14 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:14 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Flow 'volume_create_manager' (7cf21d3f-385d-4d55-9976-180a88ff017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ea2a20-5739-4538-a016-a32210166aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ea2a20-5739-4538-a016-a32210166aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1609595364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221ff781187842b39400b04997d6f218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:14Z,use_quota=True,user_id='dab9a25e3d714969b356deedf979bb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682efc2b-51a8-4150-ac57-72b099925b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682efc2b-51a8-4150-ac57-72b099925b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5698436-434e-4989-8898-d192cd2057a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5698436-434e-4989-8898-d192cd2057a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d', 'volume_name': 'volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede61435-081f-457f-b46d-e56e6abe13e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede61435-081f-457f-b46d-e56e6abe13e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af8fa55-28cf-4bbb-96b0-18dc4866e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:14 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Volume f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d', 'volume_size': 1} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1609595364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221ff781187842b39400b04997d6f218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:14Z,use_quota=True,user_id='dab9a25e3d714969b356deedf979bb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Creating volume f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:55:14 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:55:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:14 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d 1073741824 Apr 09 16:55:14 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Acquiring lock "cinder-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "cinder-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Acquiring lock "cinder-quobyte-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "cinder-quobyte-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0" acquired by "delete_volume" :: waited 0.030s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2132c7-ac47-4174-b381-42ee4d028b9a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:15 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 Apr 09 16:55:15 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:15 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 1.528s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:15 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea" returned: 0 in 2.229s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:15 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea Apr 09 16:55:15 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:16 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d 1073741824" returned: 0 in 1.880s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:16 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d Apr 09 16:55:16 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:16 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0" returned: 0 in 1.102s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:16 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0 Apr 09 16:55:16 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:16 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea.85b65225-e1e6-4c3f-a534-a61ae22000ea" returned: 0 in 0.583s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-85b65225-e1e6-4c3f-a534-a61ae22000ea" released by "_delete_snapshot" :: held 4.490s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-dea099f0-9a8b-4f8c-b587-2151f680cbea" released by "delete_snapshot" :: held 4.514s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Created reservations ['eca89666-9997-43c0-88a4-32f2296874a9', '9f84f961-4d76-43f2-a8fb-e08771f5ccef', 'e63ebe54-bbe3-4cd0-8ba5-cbe6c8e46147', '2242a4ec-5d6d-4964-a756-caaeea23cd1b'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Delete snapshot completed successfully. Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-41c44d92-fe49-4bb8-8923-b0770374fcfd tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-85b65225-e1e6-4c3f-a534-a61ae22000ea-delete_snapshot" released by "delete_snapshot" :: held 4.678s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:16 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d" returned: 0 in 0.598s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.528s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af8fa55-28cf-4bbb-96b0-18dc4866e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af345bb-6220-4243-9a3c-4e798af179b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:16 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Volume volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d (f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d): created successfully Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af345bb-6220-4243-9a3c-4e798af179b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Flow 'volume_create_manager' (7cf21d3f-385d-4d55-9976-180a88ff017d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:17 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-fc5a616d-e117-48af-bb60-2e823d9c59ff tempest-VolumeQuotasNegativeTestJSON-349039189 None] Created volume successfully. Apr 09 16:55:17 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0" returned: 0 in 0.645s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "cinder-quobyte-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0" released by "delete_volume" :: held 1.795s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Created reservations ['23719181-9971-4e58-97bc-fbbdf81fb422', '76c151c5-99c0-4c82-ac9d-454f45118714', '46cd3456-0d6f-41e7-a38d-30b94a1b7638', '546b14b6-0b66-4824-a7e7-85aa97980ea4'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:17 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:17 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-dea099f0-9a8b-4f8c-b587-2151f680cbea-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-dea099f0-9a8b-4f8c-b587-2151f680cbea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "cinder-quobyte-dea099f0-9a8b-4f8c-b587-2151f680cbea" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-dea099f0-9a8b-4f8c-b587-2151f680cbea" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb90a1c0-adf0-4871-be7b-72a76044d2e4]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:17 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea Apr 09 16:55:17 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:17 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.610s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:17 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Deleted volume successfully. Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:DELETE=22,cinder:INSERT=42,cinder:UPDATE=214,cinder:SELECT=144 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:55:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9f535d08-4ae4-40cc-a736-c5f46af84606 tempest-ServerRescueNegativeTestJSON-1470487662 None] Lock "cinder-3ec74bee-b61a-42b9-ab11-e02eff9fa2a0-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:18 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea" returned: 0 in 0.855s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:18 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea Apr 09 16:55:18 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Acquiring lock "cinder-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "cinder-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=185,cinder:INSERT=71,cinder:DELETE=13,cinder:SELECT=162 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Acquiring lock "cinder-quobyte-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "cinder-quobyte-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48b60d6-2c9b-43c3-8895-17b22f479450]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:18 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d Apr 09 16:55:18 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:18 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-dea099f0-9a8b-4f8c-b587-2151f680cbea" returned: 0 in 0.623s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-quobyte-dea099f0-9a8b-4f8c-b587-2151f680cbea" released by "delete_volume" :: held 1.542s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Created reservations ['6f948cd5-089d-4d56-a6c0-5f3e8b5d613b', '719f4e32-1028-4e88-998d-eaed73a24d3c', 'a7248cdb-c2a1-47a0-89f9-847c4eba160e', '59a7e15a-26a6-4ff6-be71-f8a57278e042'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:19 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:19 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:19 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d" returned: 0 in 0.726s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:19 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d Apr 09 16:55:19 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:19 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.641s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:19 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Deleted volume successfully. Apr 09 16:55:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91103a1f-bc50-4e36-bf75-552206d423a6 tempest-CreateVolumesFromSnapshotTest-806553478 None] Lock "cinder-dea099f0-9a8b-4f8c-b587-2151f680cbea-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:20 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d" returned: 0 in 0.580s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "cinder-quobyte-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d" released by "delete_volume" :: held 1.327s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Created reservations ['89d78a32-72df-4de0-b079-19538219f997', '8dd6f1ec-1fa3-4792-a400-e0173ecf4245', '51695d88-76fa-4f2d-81a9-c29ba62f56c4', '3a5fd318-7617-4329-8cba-9ce86a7658fb'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:20 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:20 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:21 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.821s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:21 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:21 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Deleted volume successfully. Apr 09 16:55:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e612dee9-82d2-4c8f-8489-cf0cfc2fbe15 tempest-VolumeQuotasNegativeTestJSON-349039189 None] Lock "cinder-f24f3b30-0d0e-4c4c-bf3c-d3a9b90fcd9d-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Flow 'volume_create_manager' (2a20f9cb-179d-4a66-917d-993ba57c6fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2e4af1-5b19-427f-921a-10781647679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2e4af1-5b19-427f-921a-10781647679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1074109714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f370d9-e1ff-443d-b425-0e68c89ce4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84be4e90339f4a478106bc673e147549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:25Z,use_quota=True,user_id='f1c1bc9650b945d08eea95ebfef29770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c42c600c-42b7-4f61-9d88-885c1db3373d),volume_type_id=c42c600c-42b7-4f61-9d88-885c1db3373d)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14565485-890c-4478-96a6-0ef2a6368831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14565485-890c-4478-96a6-0ef2a6368831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d63019-e6ac-4af0-a26b-61b48076cd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d63019-e6ac-4af0-a26b-61b48076cd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f370d9-e1ff-443d-b425-0e68c89ce4a0', 'volume_name': 'volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384f32cf-7a81-4e9d-9c4a-a2ed2d2c6cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384f32cf-7a81-4e9d-9c4a-a2ed2d2c6cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc0808b-de0b-4a55-a542-233eda228c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:24 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Volume 38f370d9-e1ff-443d-b425-0e68c89ce4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0', 'volume_size': 1} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1074109714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f370d9-e1ff-443d-b425-0e68c89ce4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84be4e90339f4a478106bc673e147549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:25Z,use_quota=True,user_id='f1c1bc9650b945d08eea95ebfef29770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c42c600c-42b7-4f61-9d88-885c1db3373d),volume_type_id=c42c600c-42b7-4f61-9d88-885c1db3373d)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Creating volume 38f370d9-e1ff-443d-b425-0e68c89ce4a0 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:55:24 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:55:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:24 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 1073741824 Apr 09 16:55:24 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:25 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 1073741824" returned: 0 in 0.587s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:25 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 Apr 09 16:55:25 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:25 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0" returned: 0 in 0.424s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc0808b-de0b-4a55-a542-233eda228c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f8dc47-bab8-49d1-831b-d12529c38161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Volume volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 (38f370d9-e1ff-443d-b425-0e68c89ce4a0): created successfully Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f8dc47-bab8-49d1-831b-d12529c38161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Flow 'volume_create_manager' (2a20f9cb-179d-4a66-917d-993ba57c6fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:25 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-41592333-f6d3-40d3-a1a0-89cd24e48d49 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Created volume successfully. Apr 09 16:55:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:27 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:27 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:27 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.510s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:27 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ffb07e08-b6df-4280-8195-73651199ea69 tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Retype volume completed successfully. Apr 09 16:55:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Acquiring lock "cinder-38f370d9-e1ff-443d-b425-0e68c89ce4a0-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "cinder-38f370d9-e1ff-443d-b425-0e68c89ce4a0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Acquiring lock "cinder-quobyte-38f370d9-e1ff-443d-b425-0e68c89ce4a0" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "cinder-quobyte-38f370d9-e1ff-443d-b425-0e68c89ce4a0" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:28 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a398f4cf-a159-4786-8cda-be83fabf0fdd]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:28 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 Apr 09 16:55:28 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:28 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0" returned: 0 in 0.620s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:28 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0 Apr 09 16:55:28 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:29 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-38f370d9-e1ff-443d-b425-0e68c89ce4a0" returned: 0 in 0.492s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "cinder-quobyte-38f370d9-e1ff-443d-b425-0e68c89ce4a0" released by "delete_volume" :: held 1.150s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:29 devstack cinder-volume[82139]: WARNING cinder.quota [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:55:29 devstack cinder-volume[82139]: WARNING cinder.quota [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Created reservations ['a523c104-c389-42af-a4d5-04be8ad13f68', 'a7e5c183-d581-4096-999d-cdd70ef1092b', '6603a831-2d9b-45ee-904c-bc236d3e0f2f', 'f8e40740-33e0-4ca9-8c6e-ccbeb422df88'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:29 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:29 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-104091fb-1207-437b-8190-77a55f98dff7 tempest-VolumesActionsTest-188656524 None] Acquiring lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af" by "attach_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-104091fb-1207-437b-8190-77a55f98dff7 tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af" acquired by "attach_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-104091fb-1207-437b-8190-77a55f98dff7 tempest-VolumesActionsTest-188656524 None] Attaching volume 76946907-fed0-4dbe-a078-9d7ff68d56af to instance d875b749-29a8-444f-811a-a41bdf28a88d at mountpoint /dev/vdb on host None. Apr 09 16:55:30 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.551s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:30 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Deleted volume successfully. Apr 09 16:55:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-104091fb-1207-437b-8190-77a55f98dff7 tempest-VolumesActionsTest-188656524 None] Attach volume completed successfully. Apr 09 16:55:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-104091fb-1207-437b-8190-77a55f98dff7 tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af" released by "attach_volume" :: held 0.080s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d444cec6-c963-4db2-b6ac-6d41ebcc663e tempest-VolumeRetypeWithoutMigrationTest-48638917 None] Lock "cinder-38f370d9-e1ff-443d-b425-0e68c89ce4a0-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7e913659-4ddd-4803-b21d-fcca52d3f709 tempest-VolumesActionsTest-188656524 None] Acquiring lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-detach_volume" by "detach_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7e913659-4ddd-4803-b21d-fcca52d3f709 tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7e913659-4ddd-4803-b21d-fcca52d3f709 tempest-VolumesActionsTest-188656524 None] Detaching volume 76946907-fed0-4dbe-a078-9d7ff68d56af from instance d875b749-29a8-444f-811a-a41bdf28a88d. Apr 09 16:55:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7e913659-4ddd-4803-b21d-fcca52d3f709 tempest-VolumesActionsTest-188656524 None] Detach volume completed successfully. Apr 09 16:55:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7e913659-4ddd-4803-b21d-fcca52d3f709 tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Flow 'volume_create_manager' (060b01b6-f1c4-4524-bc95-ea7d04a546e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a351e18-458e-490f-be96-a62fd1274033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a351e18-458e-490f-be96-a62fd1274033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-599164131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4af9d0-887b-43da-bd9d-7423b4cd0829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5913c823d1e4507873045fe86112508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:33Z,use_quota=True,user_id='a2696e46e8004b4ba3988971aab298df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230d37f3-484d-4a0d-b61c-8f72ec0f4ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230d37f3-484d-4a0d-b61c-8f72ec0f4ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c8df19-b355-4529-a559-a4baf6dd13d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c8df19-b355-4529-a559-a4baf6dd13d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4af9d0-887b-43da-bd9d-7423b4cd0829', 'volume_name': 'volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b505e15-08ab-4865-b0c1-34342574947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b505e15-08ab-4865-b0c1-34342574947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46f78de-786f-4d1b-9623-fc58a16d52b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:33 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Volume ce4af9d0-887b-43da-bd9d-7423b4cd0829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829', 'volume_size': 1} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-599164131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4af9d0-887b-43da-bd9d-7423b4cd0829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5913c823d1e4507873045fe86112508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:33Z,use_quota=True,user_id='a2696e46e8004b4ba3988971aab298df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Creating volume ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:55:33 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:55:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:33 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 1073741824 Apr 09 16:55:33 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:34 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 1073741824" returned: 0 in 0.589s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:34 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 Apr 09 16:55:34 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:34 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829" returned: 0 in 0.452s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46f78de-786f-4d1b-9623-fc58a16d52b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ceb9c3-9a47-4c29-bc15-2c6e17179e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:34 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Volume volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 (ce4af9d0-887b-43da-bd9d-7423b4cd0829): created successfully Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ceb9c3-9a47-4c29-bc15-2c6e17179e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Flow 'volume_create_manager' (060b01b6-f1c4-4524-bc95-ea7d04a546e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:34 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2bc06045-a630-48e2-848e-ee78e6f96705 tempest-VolumesDeleteCascade-195806201 None] Created volume successfully. Apr 09 16:55:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Creating offline snapshot 3d3e06aa-c351-409b-83d3-873c7a48b072 of volume ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:55:35 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea4f3c1-7912-40d5-9224-8ec9a5db423e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:35 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 Apr 09 16:55:35 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:36 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829" returned: 0 in 0.579s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:36 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 1G Apr 09 16:55:36 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:36 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 1G" returned: 0 in 0.520s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:36 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 Apr 09 16:55:36 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:37 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072" returned: 0 in 0.505s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:37 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 is being set with open permissions: ugo+rw Apr 09 16:55:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:37 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 Apr 09 16:55:37 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:37 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072" returned: 0 in 0.549s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:37 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.info Apr 09 16:55:37 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:38 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.info" returned: 0 in 0.506s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:38 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.info is being set with open permissions: ugo+rw Apr 09 16:55:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:38 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.info Apr 09 16:55:38 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:38 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.info" returned: 0 in 0.437s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.169s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:38 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-5bbef7bb-916e-4f08-8206-6ef20dc4ec91 tempest-VolumesDeleteCascade-195806201 None] Create snapshot completed successfully Apr 09 16:55:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Creating offline snapshot 534bb419-3bde-42a5-9561-8d2e780ea948 of volume ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:55:39 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f60f1f-25d9-413f-883d-64825aa7f885]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:40 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 Apr 09 16:55:40 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:40 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072" returned: 0 in 0.489s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:55:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:40 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 1G Apr 09 16:55:40 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:41 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 1G" returned: 0 in 0.539s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:41 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 Apr 09 16:55:41 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:41 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948" returned: 0 in 0.460s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:41 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 is being set with open permissions: ugo+rw Apr 09 16:55:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:41 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 Apr 09 16:55:41 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:41 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948" returned: 0 in 0.445s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:41 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-5b3cb8f7-ef9f-4081-aa07-6ff5ebc63cdb tempest-VolumesDeleteCascade-195806201 None] Create snapshot completed successfully Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-ce4af9d0-887b-43da-bd9d-7423b4cd0829-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-ce4af9d0-887b-43da-bd9d-7423b4cd0829-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Performing cascade delete. {{(pid=82139) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-3d3e06aa-c351-409b-83d3-873c7a48b072-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-3d3e06aa-c351-409b-83d3-873c7a48b072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-3d3e06aa-c351-409b-83d3-873c7a48b072" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-3d3e06aa-c351-409b-83d3-873c7a48b072" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Deleting offline snapshot 3d3e06aa-c351-409b-83d3-873c7a48b072 of volume ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] snapshot_file for this snap is: volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87f38a-c0d1-4dec-b3a3-22b7dfeeb882]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:42 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 Apr 09 16:55:42 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:42 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072" returned: 0 in 0.601s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8014de-a604-40f8-a6f1-4ba28759f7ca]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:42 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 Apr 09 16:55:42 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:43 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829" returned: 0 in 0.530s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:43 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc341a-1d01-4ce0-a97b-dcdba97b7b27]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:43 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 Apr 09 16:55:43 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:43 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948" returned: 0 in 0.588s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:55:43 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e165dcb-e8e4-4770-bf16-73d1c20c0e79]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:44 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 Apr 09 16:55:44 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:44 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072" returned: 0 in 0.542s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:55:44 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3202037-f11d-4208-a20a-250289630750]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:44 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 Apr 09 16:55:44 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:45 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829" returned: 0 in 0.549s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:45 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 Apr 09 16:55:45 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:45 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072" returned: 0 in 0.514s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:45 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072 Apr 09 16:55:45 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:46 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.3d3e06aa-c351-409b-83d3-873c7a48b072" returned: 0 in 0.467s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 -F qcow2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:46 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 -F qcow2 Apr 09 16:55:46 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:46 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 -F qcow2" returned: 0 in 0.510s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-3d3e06aa-c351-409b-83d3-873c7a48b072" released by "_delete_snapshot" :: held 4.424s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" released by "delete_snapshot" :: held 4.438s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Created reservations ['4a1eb58e-2fba-4b53-b006-560575f01460', '1878e2fb-967a-4aeb-ac04-e141942b01a6', '9e0f0f61-4622-4992-bc6b-675bdd634b82', '408a81fa-ea7d-436f-805c-9a53f255c89a'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:46 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Delete snapshot completed successfully. Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-3d3e06aa-c351-409b-83d3-873c7a48b072-delete_snapshot" released by "delete_snapshot" :: held 4.535s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-534bb419-3bde-42a5-9561-8d2e780ea948-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-534bb419-3bde-42a5-9561-8d2e780ea948-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-534bb419-3bde-42a5-9561-8d2e780ea948" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-534bb419-3bde-42a5-9561-8d2e780ea948" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Deleting offline snapshot 534bb419-3bde-42a5-9561-8d2e780ea948 of volume ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] snapshot_file for this snap is: volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[91db1522-9dfb-46d0-8980-0a805fda4405]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:46 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 Apr 09 16:55:46 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:47 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948" returned: 0 in 0.520s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:55:47 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed61ccb6-a984-4fb5-8591-0dd88c218d44]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:47 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 Apr 09 16:55:47 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:47 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829" returned: 0 in 0.555s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:47 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 Apr 09 16:55:47 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:48 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948" returned: 0 in 0.672s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:48 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948 Apr 09 16:55:48 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:49 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829.534bb419-3bde-42a5-9561-8d2e780ea948" returned: 0 in 0.528s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-534bb419-3bde-42a5-9561-8d2e780ea948" released by "_delete_snapshot" :: held 2.333s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" released by "delete_snapshot" :: held 2.344s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Created reservations ['1aab01cd-65fc-4a63-b031-00c0b2e609ef', 'edb320ce-bded-444e-af63-d75c3993a34e', '16301ccb-3a54-4ea1-923c-5a4d5eb59f39', 'cdba2485-6b67-4d93-884a-a76c75243e8a'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:49 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Delete snapshot completed successfully. Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-534bb419-3bde-42a5-9561-8d2e780ea948-delete_snapshot" released by "delete_snapshot" :: held 2.440s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Snapshots deleted, issuing volume delete {{(pid=82139) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba025cf-e09f-4012-8950-74e9c0ede1e9]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:49 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 Apr 09 16:55:49 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:49 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829" returned: 0 in 0.683s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:49 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829 Apr 09 16:55:49 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:50 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ce4af9d0-887b-43da-bd9d-7423b4cd0829" returned: 0 in 0.449s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-ce4af9d0-887b-43da-bd9d-7423b4cd0829" released by "delete_volume" :: held 1.176s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Created reservations ['c6ca3207-2c0e-4863-91ec-eec08f1a6d9b', '70f7b3c7-d3b9-4199-8105-73622df6852d', '21552761-21e6-4858-88e9-f2049cb7e5af', 'd46018c9-e298-480e-affb-880ab951c644'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:50 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:55:50 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:51 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.658s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:55:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Deleted volume successfully. Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8c218f75-edc5-46c6-938e-a45bd1b0b595 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-ce4af9d0-887b-43da-bd9d-7423b4cd0829-delete_volume" released by "delete_volume" :: held 8.995s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Flow 'volume_create_manager' (2311313c-4330-439b-96cc-96b381ff6d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f976b59a-416e-4f3d-a883-bd6460950dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f976b59a-416e-4f3d-a883-bd6460950dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-376236248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282cb619-e144-46ee-9256-a7dcb25fe0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5913c823d1e4507873045fe86112508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:51Z,use_quota=True,user_id='a2696e46e8004b4ba3988971aab298df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395596b-6f58-4304-b7b5-5d87d70ac681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395596b-6f58-4304-b7b5-5d87d70ac681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1448f4db-d504-4927-af44-79000a78d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1448f4db-d504-4927-af44-79000a78d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282cb619-e144-46ee-9256-a7dcb25fe0ed', 'volume_name': 'volume-282cb619-e144-46ee-9256-a7dcb25fe0ed', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1f2648-f832-45ca-9263-a688c0310995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1f2648-f832-45ca-9263-a688c0310995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3484985d-f56a-40f3-8bf1-73237da87ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:51 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Volume 282cb619-e144-46ee-9256-a7dcb25fe0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282cb619-e144-46ee-9256-a7dcb25fe0ed', 'volume_size': 1} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-376236248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282cb619-e144-46ee-9256-a7dcb25fe0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5913c823d1e4507873045fe86112508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:51Z,use_quota=True,user_id='a2696e46e8004b4ba3988971aab298df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Creating volume 282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:55:51 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e20c79cd-8cd2-4b87-bc3c-91b1f08f825a tempest-VolumesActionsTest-188656524 None] Acquiring lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af" by "attach_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:51 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed 1073741824 Apr 09 16:55:51 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e20c79cd-8cd2-4b87-bc3c-91b1f08f825a tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af" acquired by "attach_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e20c79cd-8cd2-4b87-bc3c-91b1f08f825a tempest-VolumesActionsTest-188656524 None] Attaching volume 76946907-fed0-4dbe-a078-9d7ff68d56af to instance 3569b229-e2eb-4a34-bdca-f69817bce2b3 at mountpoint /dev/vdb on host None. Apr 09 16:55:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e20c79cd-8cd2-4b87-bc3c-91b1f08f825a tempest-VolumesActionsTest-188656524 None] Attach volume completed successfully. Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e20c79cd-8cd2-4b87-bc3c-91b1f08f825a tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af" released by "attach_volume" :: held 0.063s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fa6d32c7-3a8f-469d-b206-d27e3e774dde tempest-VolumesActionsTest-188656524 None] Acquiring lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-detach_volume" by "detach_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fa6d32c7-3a8f-469d-b206-d27e3e774dde tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-fa6d32c7-3a8f-469d-b206-d27e3e774dde tempest-VolumesActionsTest-188656524 None] Detaching volume 76946907-fed0-4dbe-a078-9d7ff68d56af from instance 3569b229-e2eb-4a34-bdca-f69817bce2b3. Apr 09 16:55:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-fa6d32c7-3a8f-469d-b206-d27e3e774dde tempest-VolumesActionsTest-188656524 None] Detach volume completed successfully. Apr 09 16:55:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fa6d32c7-3a8f-469d-b206-d27e3e774dde tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:55:52 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed 1073741824" returned: 0 in 0.782s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:52 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed Apr 09 16:55:52 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:52 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3484985d-f56a-40f3-8bf1-73237da87ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282cb619-e144-46ee-9256-a7dcb25fe0ed', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f137dba0-76f4-4274-9caf-2fdf0794f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:52 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Volume volume-282cb619-e144-46ee-9256-a7dcb25fe0ed (282cb619-e144-46ee-9256-a7dcb25fe0ed): created successfully Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f137dba0-76f4-4274-9caf-2fdf0794f909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Flow 'volume_create_manager' (2311313c-4330-439b-96cc-96b381ff6d95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-738835b6-795f-4739-8260-8d0b454fb5dd tempest-VolumesDeleteCascade-195806201 None] Created volume successfully. Apr 09 16:55:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Creating offline snapshot a08255d6-3bb9-43f5-8bcb-39a1bce69839 of volume 282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:55:53 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[188639f2-2852-4f76-bfe7-262693533fff]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:53 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed Apr 09 16:55:53 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:54 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed" returned: 0 in 0.621s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:54 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 1G Apr 09 16:55:54 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:54 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 1G" returned: 0 in 0.590s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282cb619-e144-46ee-9256-a7dcb25fe0ed -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:54 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282cb619-e144-46ee-9256-a7dcb25fe0ed -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 Apr 09 16:55:54 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:55 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282cb619-e144-46ee-9256-a7dcb25fe0ed -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839" returned: 0 in 0.534s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:55 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 is being set with open permissions: ugo+rw Apr 09 16:55:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:55 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 Apr 09 16:55:55 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:55 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839" returned: 0 in 0.475s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:55 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.info Apr 09 16:55:55 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:56 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.info" returned: 0 in 0.507s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:56 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.info is being set with open permissions: ugo+rw Apr 09 16:55:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:56 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.info Apr 09 16:55:56 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:56 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.info" returned: 0 in 0.448s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.240s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:56 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-040a8dd7-8f04-4c9c-9a9a-a6922a57b409 tempest-VolumesDeleteCascade-195806201 None] Create snapshot completed successfully Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Flow 'volume_create_manager' (cc0fdfe3-53c3-46fb-a3c2-d098260d1f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54a40cc-b313-4242-9873-a981c13fa8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54a40cc-b313-4242-9873-a981c13fa8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1040559640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc59562-53f7-48d7-8d68-732667fb053d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5913c823d1e4507873045fe86112508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a08255d6-3bb9-43f5-8bcb-39a1bce69839,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:55:58Z,use_quota=True,user_id='a2696e46e8004b4ba3988971aab298df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5e9c65-baa0-4ad7-bc99-041d1348963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5e9c65-baa0-4ad7-bc99-041d1348963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f59a72-78d0-45d1-a26c-2b37eedc8122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f59a72-78d0-45d1-a26c-2b37eedc8122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8dc59562-53f7-48d7-8d68-732667fb053d', 'volume_name': 'volume-8dc59562-53f7-48d7-8d68-732667fb053d', 'volume_size': 1, 'snapshot_id': 'a08255d6-3bb9-43f5-8bcb-39a1bce69839'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5decf1c6-187c-496a-9555-d4e261c424df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5decf1c6-187c-496a-9555-d4e261c424df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c7d5f3-45a5-4311-83cb-75b5920d79e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:55:57 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Volume 8dc59562-53f7-48d7-8d68-732667fb053d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8dc59562-53f7-48d7-8d68-732667fb053d', 'volume_size': 1, 'snapshot_id': 'a08255d6-3bb9-43f5-8bcb-39a1bce69839'} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-a08255d6-3bb9-43f5-8bcb-39a1bce69839-8dc59562-53f7-48d7-8d68-732667fb053d" by "_create_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-a08255d6-3bb9-43f5-8bcb-39a1bce69839-8dc59562-53f7-48d7-8d68-732667fb053d" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Creating volume 8dc59562-53f7-48d7-8d68-732667fb053d from snapshot a08255d6-3bb9-43f5-8bcb-39a1bce69839 {{(pid=82139) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-8dc59562-53f7-48d7-8d68-732667fb053d" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-8dc59562-53f7-48d7-8d68-732667fb053d" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] snapshot: a08255d6-3bb9-43f5-8bcb-39a1bce69839, volume: 8dc59562-53f7-48d7-8d68-732667fb053d, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4b3fa-6893-4f5d-b9d1-6d9589aaf965]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:58 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 Apr 09 16:55:58 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:58 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839" returned: 0 in 0.568s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-282cb619-e144-46ee-9256-a7dcb25fe0ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:55:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:55:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:55:58 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a6c342-34ca-4048-ac11-7faebd765bdb]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:55:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:58 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed Apr 09 16:55:58 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:59 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Apr 09 16:55:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed" returned: 0 in 0.615s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:55:59 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:55:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:55:59 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d Apr 09 16:55:59 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:55:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:01 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d" returned: 0 in 2.303s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:01 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7906423-283f-444a-958f-13e23d618015]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:01 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed Apr 09 16:56:01 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:02 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed" returned: 0 in 0.673s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:56:02 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Converted 1024.00 MB image at 444.40 MB/s Apr 09 16:56:02 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d is being set with open permissions: ugo+rw Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:02 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d Apr 09 16:56:02 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:02 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d" returned: 0 in 0.451s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-8dc59562-53f7-48d7-8d68-732667fb053d" released by "_copy_volume_from_snapshot" :: held 4.668s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-a08255d6-3bb9-43f5-8bcb-39a1bce69839-8dc59562-53f7-48d7-8d68-732667fb053d" released by "_create_volume_from_snapshot" :: held 4.685s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.696s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.739s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf53a87-21cf-4103-b387-9ffa0df44832]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c7d5f3-45a5-4311-83cb-75b5920d79e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc59562-53f7-48d7-8d68-732667fb053d', 'volume_size': 1, 'snapshot_id': 'a08255d6-3bb9-43f5-8bcb-39a1bce69839'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985803e5-09dd-46c8-ae4a-19b4a3d55c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:02 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Volume volume-8dc59562-53f7-48d7-8d68-732667fb053d (8dc59562-53f7-48d7-8d68-732667fb053d): created successfully Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985803e5-09dd-46c8-ae4a-19b4a3d55c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Flow 'volume_create_manager' (cc0fdfe3-53c3-46fb-a3c2-d098260d1f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3b6a4d67-9a55-4b5b-9227-711ea07954c0 tempest-VolumesDeleteCascade-195806201 None] Created volume successfully. Apr 09 16:56:02 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:56:02 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:03 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 0.519s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[df042ea7-9665-40e5-acbc-c1313d98d544]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:03 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:56:03 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-282cb619-e144-46ee-9256-a7dcb25fe0ed-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-282cb619-e144-46ee-9256-a7dcb25fe0ed-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Performing cascade delete. {{(pid=82139) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-a08255d6-3bb9-43f5-8bcb-39a1bce69839-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-a08255d6-3bb9-43f5-8bcb-39a1bce69839-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-282cb619-e144-46ee-9256-a7dcb25fe0ed" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-282cb619-e144-46ee-9256-a7dcb25fe0ed" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-a08255d6-3bb9-43f5-8bcb-39a1bce69839" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-a08255d6-3bb9-43f5-8bcb-39a1bce69839" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Deleting offline snapshot a08255d6-3bb9-43f5-8bcb-39a1bce69839 of volume 282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] snapshot_file for this snap is: volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b7524-15a6-4565-b79f-42f3acdb8141]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:03 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 Apr 09 16:56:03 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:03 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 0.543s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.044286d0-d740-4627-b135-bd1529618ebfcpkos5x1.img {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:03 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.044286d0-d740-4627-b135-bd1529618ebfcpkos5x1.img Apr 09 16:56:03 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:03 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839" returned: 0 in 0.555s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-282cb619-e144-46ee-9256-a7dcb25fe0ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:56:04 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a79e74-dc3c-4804-9de2-992b5cbe86be]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:04 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed Apr 09 16:56:04 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:05 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed" returned: 0 in 1.451s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:05 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 Apr 09 16:56:05 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:05 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.044286d0-d740-4627-b135-bd1529618ebfcpkos5x1.img" returned: 0 in 2.121s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:05 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[374ac91c-7a63-4f2f-9fe9-9b8c351e0874]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:05 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:56:05 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:06 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839" returned: 0 in 0.647s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:06 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839 Apr 09 16:56:06 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:06 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 0.671s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.044286d0-d740-4627-b135-bd1529618ebfcpkos5x1.img {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:56:06 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Converted 1024.00 MB image at 482.53 MB/s Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] 044286d0-d740-4627-b135-bd1529618ebf was raw, no need to convert to raw {{(pid=82139) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 09 16:56:06 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed.a08255d6-3bb9-43f5-8bcb-39a1bce69839" returned: 0 in 0.587s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-a08255d6-3bb9-43f5-8bcb-39a1bce69839" released by "_delete_snapshot" :: held 3.293s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-282cb619-e144-46ee-9256-a7dcb25fe0ed" released by "delete_snapshot" :: held 3.305s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Created reservations ['ddf8b9d2-ac49-485d-aa2d-f0a8a3ecfe91', '81ca9090-6753-4a80-b791-083bc6a494ee', 'b6a0e644-3f47-4bb0-863b-3c0bdf897bb6', 'e7f02077-5c3f-4a7a-a984-957c8ac2f4f4'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Delete snapshot completed successfully. Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-a08255d6-3bb9-43f5-8bcb-39a1bce69839-delete_snapshot" released by "delete_snapshot" :: held 3.460s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Snapshots deleted, issuing volume delete {{(pid=82139) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-282cb619-e144-46ee-9256-a7dcb25fe0ed" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-282cb619-e144-46ee-9256-a7dcb25fe0ed" acquired by "delete_volume" :: waited 0.015s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ce24ac-3e58-49fc-9bc3-9241a70718bf]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:06 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed Apr 09 16:56:06 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:07 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:07 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed Apr 09 16:56:07 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:07 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-282cb619-e144-46ee-9256-a7dcb25fe0ed" returned: 0 in 0.591s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-282cb619-e144-46ee-9256-a7dcb25fe0ed" released by "delete_volume" :: held 1.147s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Created reservations ['924693b1-321b-4b0a-b54d-3964e6673ce3', '08aa4193-9b62-41c5-9f38-aa6fbfed3a7e', 'f3b9570a-1829-4ad1-840d-3338f4691316', 'de8f62a0-5d0b-4645-8778-cc09674ec638'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:08 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:08 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:08 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.558s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:08 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Deleted volume successfully. Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7edfe01a-6787-4460-a0ed-53f121dfa98f tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-282cb619-e144-46ee-9256-a7dcb25fe0ed-delete_volume" released by "delete_volume" :: held 5.348s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-8dc59562-53f7-48d7-8d68-732667fb053d-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-8dc59562-53f7-48d7-8d68-732667fb053d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "cinder-quobyte-8dc59562-53f7-48d7-8d68-732667fb053d" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-8dc59562-53f7-48d7-8d68-732667fb053d" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a54b60a-a3be-4a43-8320-2d587bb5b55d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:09 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d Apr 09 16:56:09 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:09 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d" returned: 0 in 0.588s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:09 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d Apr 09 16:56:09 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:10 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8dc59562-53f7-48d7-8d68-732667fb053d" returned: 0 in 0.618s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-quobyte-8dc59562-53f7-48d7-8d68-732667fb053d" released by "delete_volume" :: held 1.237s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Created reservations ['756bee44-6d35-4ef4-adea-ee7bdea53ab0', 'cae3c49b-f12e-40fe-a41c-47515b455080', 'b159c77a-dea7-4b7d-ba7c-008560f6b541', 'b9bfa19b-d04b-4434-9ec9-ecf2df850dc4'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:10 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:10 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:10 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.574s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:10 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Deleted volume successfully. Apr 09 16:56:10 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c729821-f9f2-4532-b536-de3ebe750faa tempest-VolumesDeleteCascade-195806201 None] Lock "cinder-8dc59562-53f7-48d7-8d68-732667fb053d-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Flow 'volume_create_manager' (1f718c59-a06b-4012-aaad-7e008b833944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cbf15c-29b6-4c8c-83cb-e3239eed5e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cbf15c-29b6-4c8c-83cb-e3239eed5e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2100165344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2736985-d8d4-4c70-8b24-21c75233d36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5737d9b8119d486f99f303f446e2bc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:13Z,use_quota=True,user_id='6f684788f49743bb88df92f380f1a7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f37d63-5b6b-4f61-a939-e80b94836bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f37d63-5b6b-4f61-a939-e80b94836bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e28dd4-e6d4-4e2b-9ede-70df09e78776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e28dd4-e6d4-4e2b-9ede-70df09e78776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2736985-d8d4-4c70-8b24-21c75233d36c', 'volume_name': 'volume-f2736985-d8d4-4c70-8b24-21c75233d36c', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f93184b-4b48-48fa-b9d9-4248b4c3d6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f93184b-4b48-48fa-b9d9-4248b4c3d6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab9f265-7c1d-45f3-8380-05a9257a763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:13 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Volume f2736985-d8d4-4c70-8b24-21c75233d36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2736985-d8d4-4c70-8b24-21c75233d36c', 'volume_size': 1} Apr 09 16:56:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:14 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:14 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:14 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.899s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Uploaded volume to glance image-id: 044286d0-d740-4627-b135-bd1529618ebf. {{(pid=82139) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.136s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2100165344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2736985-d8d4-4c70-8b24-21c75233d36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5737d9b8119d486f99f303f446e2bc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:13Z,use_quota=True,user_id='6f684788f49743bb88df92f380f1a7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Creating volume f2736985-d8d4-4c70-8b24-21c75233d36c {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:17 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:17 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-59babc3a-c74b-4957-a228-0aef2214b153 tempest-VolumesActionsTest-188656524 None] Copy volume to image completed successfully. Apr 09 16:56:17 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c 1073741824 Apr 09 16:56:17 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:18 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c 1073741824" returned: 0 in 0.513s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=74,cinder:SELECT=94,cinder:INSERT=24,cinder:DELETE=6 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:18 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c Apr 09 16:56:18 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:18 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c" returned: 0 in 0.417s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab9f265-7c1d-45f3-8380-05a9257a763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2736985-d8d4-4c70-8b24-21c75233d36c', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ac8b20-1b3e-4492-aa67-d5bdac8d5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:18 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Volume volume-f2736985-d8d4-4c70-8b24-21c75233d36c (f2736985-d8d4-4c70-8b24-21c75233d36c): created successfully Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ac8b20-1b3e-4492-aa67-d5bdac8d5560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Flow 'volume_create_manager' (1f718c59-a06b-4012-aaad-7e008b833944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:18 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-82317ec4-c002-49c0-9506-129dae344900 tempest-VolumesMetadataTest-1749286842 None] Created volume successfully. Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24cff5b-45d4-4efa-8723-55c1beaa9284]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:19 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:56:19 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Acquiring lock "cinder-f2736985-d8d4-4c70-8b24-21c75233d36c-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Lock "cinder-f2736985-d8d4-4c70-8b24-21c75233d36c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=80,cinder:UPDATE=110,cinder:INSERT=22,cinder:DELETE=8 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Acquiring lock "cinder-quobyte-f2736985-d8d4-4c70-8b24-21c75233d36c" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Lock "cinder-quobyte-f2736985-d8d4-4c70-8b24-21c75233d36c" acquired by "delete_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[535e6dcc-b687-4cdb-b8be-15e5f5f2bff6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:19 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c Apr 09 16:56:19 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:19 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 0.546s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd9c37-d5cd-4902-924a-36ceda1dbef8]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:19 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:56:19 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:19 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c" returned: 0 in 0.497s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:19 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c Apr 09 16:56:19 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:20 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 0.495s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:20 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img Apr 09 16:56:20 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:20 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f2736985-d8d4-4c70-8b24-21c75233d36c" returned: 0 in 0.434s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Lock "cinder-quobyte-f2736985-d8d4-4c70-8b24-21c75233d36c" released by "delete_volume" :: held 0.956s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Created reservations ['7eb614f4-4e29-4fc9-97b8-b8f6d73b7fd2', '48b0a906-f299-4c47-91f5-ac91f3081cbe', '9b2cf307-3d8a-4db5-8038-ff3d827dbd19', 'c00c29fe-b9db-4748-b0e5-d781c9e781c7'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:20 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:20 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:20 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.595s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:20 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Deleted volume successfully. Apr 09 16:56:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1e6b7822-de78-4ff7-9000-3ed9499df707 tempest-VolumesMetadataTest-1749286842 None] Lock "cinder-f2736985-d8d4-4c70-8b24-21c75233d36c-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:22 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img" returned: 0 in 2.798s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:22 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36c2966-bd0a-4c7b-bfc4-fe2d3f294e02]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:22 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:56:22 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:23 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 0.735s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:23 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af, size 1024.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:56:23 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Converted 1024.00 MB image at 365.34 MB/s Apr 09 16:56:23 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] 1700175d-edfe-46a2-aaf9-e0fd450184ba was raw, converting to qcow2 {{(pid=82139) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 09 16:56:23 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92c6d36-1ec7-4209-90ae-0437a1e03fba]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:23 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img Apr 09 16:56:23 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:24 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img" returned: 0 in 0.579s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:24 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img Apr 09 16:56:24 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (3f20cfeb-ed27-46b3-886b-b87abd5d27a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:24 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb50927e-7b7c-481b-8f86-2fedec41ae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img" returned: 1 in 0.679s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img /opt/stack/data/cinder/conversion/vol_upload_413bc2h3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb50927e-7b7c-481b-8f86-2fedec41ae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-283923250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e477d34-2bda-4550-96f1-f7ef41877506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:25Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3be4d7c-edd3-4bf6-ad87-9791b1f04186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3be4d7c-edd3-4bf6-ad87-9791b1f04186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:24 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img /opt/stack/data/cinder/conversion/vol_upload_413bc2h3 Apr 09 16:56:24 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d4b47e-f366-4db8-b58d-034d0e655660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d4b47e-f366-4db8-b58d-034d0e655660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e477d34-2bda-4550-96f1-f7ef41877506', 'volume_name': 'volume-0e477d34-2bda-4550-96f1-f7ef41877506', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9d728-49f1-4e18-a6b7-02c284487056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9d728-49f1-4e18-a6b7-02c284487056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ea7c72-4fac-46b6-b8e8-5bdcbc542b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:24 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Volume 0e477d34-2bda-4550-96f1-f7ef41877506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e477d34-2bda-4550-96f1-f7ef41877506', 'volume_size': 1} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Flow 'volume_create_manager' (9b1cd73f-8888-45f1-a391-d254052095f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793d76c-6f5a-4354-927e-18a9bf1be595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793d76c-6f5a-4354-927e-18a9bf1be595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1962447196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629e608b-ceec-49d7-b036-415158eb6c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e342e7281fb64424a56c6c3a2684dd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:25Z,use_quota=True,user_id='b2fd92108144475697efdd862336ba05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c3598e-bbcf-432f-a1c1-7d070b69a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c3598e-bbcf-432f-a1c1-7d070b69a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb083bc8-ce03-4b77-aaa4-20333d3c747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb083bc8-ce03-4b77-aaa4-20333d3c747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629e608b-ceec-49d7-b036-415158eb6c51', 'volume_name': 'volume-629e608b-ceec-49d7-b036-415158eb6c51', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35dd089d-5e64-4d47-a7c5-45ea4de4fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35dd089d-5e64-4d47-a7c5-45ea4de4fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f51f46-f2a3-40e6-b821-eaa7252739db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Volume 629e608b-ceec-49d7-b036-415158eb6c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629e608b-ceec-49d7-b036-415158eb6c51', 'volume_size': 1} Apr 09 16:56:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:25 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img /opt/stack/data/cinder/conversion/vol_upload_413bc2h3" returned: 0 in 0.447s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:25 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Image conversion details: src /opt/stack/data/cinder/conversion/76946907-fed0-4dbe-a078-9d7ff68d56af.temp_image.1700175d-edfe-46a2-aaf9-e0fd450184ba6mpryg9h.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_413bc2h3 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:56:25 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 09 16:56:25 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[683682e3-f5ee-414d-8607-d4e47e70d4f3]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_413bc2h3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:25 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_413bc2h3 Apr 09 16:56:25 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:25 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_413bc2h3" returned: 0 in 0.465s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.633s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Uploaded volume to glance image-id: 1700175d-edfe-46a2-aaf9-e0fd450184ba. {{(pid=82139) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.663s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-283923250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e477d34-2bda-4550-96f1-f7ef41877506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:25Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Creating volume 0e477d34-2bda-4550-96f1-f7ef41877506 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:26 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:26 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 1073741824 Apr 09 16:56:26 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:26 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-0760c534-3aee-46e6-a4c4-80345be088b6 tempest-VolumesActionsTest-188656524 None] Copy volume to image completed successfully. Apr 09 16:56:27 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 1073741824" returned: 0 in 0.525s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:27 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 Apr 09 16:56:27 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:27 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506" returned: 0 in 0.433s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.579s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1962447196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629e608b-ceec-49d7-b036-415158eb6c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e342e7281fb64424a56c6c3a2684dd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:25Z,use_quota=True,user_id='b2fd92108144475697efdd862336ba05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Creating volume 629e608b-ceec-49d7-b036-415158eb6c51 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:27 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ea7c72-4fac-46b6-b8e8-5bdcbc542b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e477d34-2bda-4550-96f1-f7ef41877506', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de419016-ac83-48bd-9b44-486b2946b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:27 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 1073741824 Apr 09 16:56:27 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:27 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Volume volume-0e477d34-2bda-4550-96f1-f7ef41877506 (0e477d34-2bda-4550-96f1-f7ef41877506): created successfully Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de419016-ac83-48bd-9b44-486b2946b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (3f20cfeb-ed27-46b3-886b-b87abd5d27a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d564b560-59cd-4b3a-93fa-a3c69444d837 tempest-VolumesActionsTest-1383670629 None] Created volume successfully. Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Acquiring lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Acquiring lock "cinder-quobyte-76946907-fed0-4dbe-a078-9d7ff68d56af" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Lock "cinder-quobyte-76946907-fed0-4dbe-a078-9d7ff68d56af" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[6944dcd5-fbdb-4d39-825e-5926cfb0d499]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:27 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:56:27 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4b11be2-4ea5-436b-adce-68c148e2d9bc tempest-VolumesActionsTest-1383670629 None] Acquiring lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506" by "attach_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4b11be2-4ea5-436b-adce-68c148e2d9bc tempest-VolumesActionsTest-1383670629 None] Lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506" acquired by "attach_volume" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c4b11be2-4ea5-436b-adce-68c148e2d9bc tempest-VolumesActionsTest-1383670629 None] Attaching volume 0e477d34-2bda-4550-96f1-f7ef41877506 to instance 7be706f0-b5c4-4926-af60-b7dd2f8a3c88 at mountpoint /dev/vdb on host None. Apr 09 16:56:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c4b11be2-4ea5-436b-adce-68c148e2d9bc tempest-VolumesActionsTest-1383670629 None] Attach volume completed successfully. Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c4b11be2-4ea5-436b-adce-68c148e2d9bc tempest-VolumesActionsTest-1383670629 None] Lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506" released by "attach_volume" :: held 0.076s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:28 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 1073741824" returned: 0 in 0.549s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:28 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 Apr 09 16:56:28 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:28 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 0.583s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:28 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af Apr 09 16:56:28 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:28 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51" returned: 0 in 0.441s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f51f46-f2a3-40e6-b821-eaa7252739db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629e608b-ceec-49d7-b036-415158eb6c51', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d8b9e1-585e-4666-88c4-e67fc7eea5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:28 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Volume volume-629e608b-ceec-49d7-b036-415158eb6c51 (629e608b-ceec-49d7-b036-415158eb6c51): created successfully Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d8b9e1-585e-4666-88c4-e67fc7eea5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Flow 'volume_create_manager' (9b1cd73f-8888-45f1-a391-d254052095f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-fd19397a-a95e-4ecf-8099-89aa0df43f19 tempest-VolumesTransfersTest-1220002441 None] Created volume successfully. Apr 09 16:56:28 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-76946907-fed0-4dbe-a078-9d7ff68d56af" returned: 0 in 0.482s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Lock "cinder-quobyte-76946907-fed0-4dbe-a078-9d7ff68d56af" released by "delete_volume" :: held 1.088s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-42afaa3e-5d89-4655-9d7b-560a2359cbf5 tempest-VolumesActionsTest-2013493775 None] Terminate volume connection completed successfully. Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Created reservations ['c50fbb54-d097-46aa-9354-bf2920468f22', '0e69ad85-2fe1-4ede-8879-ec1664cc11f7', '75e367bd-a44f-4cdd-b628-44c454737d94', 'd2e93b5c-7eae-4df1-ae59-8830649967c7'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:28 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:28 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-42afaa3e-5d89-4655-9d7b-560a2359cbf5 tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-detach_volume" by "detach_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-42afaa3e-5d89-4655-9d7b-560a2359cbf5 tempest-VolumesActionsTest-2013493775 None] Lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-42afaa3e-5d89-4655-9d7b-560a2359cbf5 tempest-VolumesActionsTest-2013493775 None] Detaching volume 0e477d34-2bda-4550-96f1-f7ef41877506 from instance 7be706f0-b5c4-4926-af60-b7dd2f8a3c88. Apr 09 16:56:29 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.485s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:29 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Deleted volume successfully. Apr 09 16:56:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-42afaa3e-5d89-4655-9d7b-560a2359cbf5 tempest-VolumesActionsTest-2013493775 None] Detach volume completed successfully. Apr 09 16:56:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ffd66217-1fff-4586-8ccb-4aeb5d1a9a47 tempest-VolumesActionsTest-188656524 None] Lock "cinder-76946907-fed0-4dbe-a078-9d7ff68d56af-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-42afaa3e-5d89-4655-9d7b-560a2359cbf5 tempest-VolumesActionsTest-2013493775 None] Lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-97d59e6b-6e63-4369-9d51-5cfdf0659f54 tempest-VolumesTransfersTest-1910201647 None] Transfer volume completed successfully. Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-341e155a-09b2-45bd-ac19-d26a344f5f15 tempest-VolumesActionsTest-1383670629 None] Acquiring lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-detach_volume" by "detach_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-341e155a-09b2-45bd-ac19-d26a344f5f15 tempest-VolumesActionsTest-1383670629 None] Lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-341e155a-09b2-45bd-ac19-d26a344f5f15 tempest-VolumesActionsTest-1383670629 None] Volume detach called, but volume not attached. Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-341e155a-09b2-45bd-ac19-d26a344f5f15 tempest-VolumesActionsTest-1383670629 None] Lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Acquiring lock "cinder-629e608b-ceec-49d7-b036-415158eb6c51-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Lock "cinder-629e608b-ceec-49d7-b036-415158eb6c51-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Acquiring lock "cinder-quobyte-629e608b-ceec-49d7-b036-415158eb6c51" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Lock "cinder-quobyte-629e608b-ceec-49d7-b036-415158eb6c51" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfa9414-a33b-4170-9c17-8dbfad9329bc]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:30 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 Apr 09 16:56:30 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Acquiring lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Acquiring lock "cinder-quobyte-0e477d34-2bda-4550-96f1-f7ef41877506" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Lock "cinder-quobyte-0e477d34-2bda-4550-96f1-f7ef41877506" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6659e0-ab54-48ed-b2eb-ba0b8b54a512]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:30 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 Apr 09 16:56:30 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:31 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51" returned: 0 in 0.620s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:31 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51 Apr 09 16:56:31 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:31 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506" returned: 0 in 0.571s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:31 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506 Apr 09 16:56:31 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:31 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-629e608b-ceec-49d7-b036-415158eb6c51" returned: 0 in 0.540s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Lock "cinder-quobyte-629e608b-ceec-49d7-b036-415158eb6c51" released by "delete_volume" :: held 1.190s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Created reservations ['4db94cab-4c23-40f4-a9fa-97111d57791f', '19d44a20-647b-4ea3-b7f1-78c6f18c46e9', '5d178b3b-a09c-42bb-a470-c6f84ff8518e', '0ea9c5b0-0364-4768-b6ba-c9eb1661bc94'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:31 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:31 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:31 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0e477d34-2bda-4550-96f1-f7ef41877506" returned: 0 in 0.502s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Lock "cinder-quobyte-0e477d34-2bda-4550-96f1-f7ef41877506" released by "delete_volume" :: held 1.109s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Created reservations ['0217b490-e2c6-43ac-803c-d377e01c7130', '14339020-d082-44c9-a93d-30f1409745a4', '3afd74fc-2759-4707-b36c-f662e1a78cc5', 'b187e884-c8ff-4a08-9a5c-34cebd851082'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:31 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:31 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:32 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.601s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:32 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Deleted volume successfully. Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7b9488b6-987c-4c15-b1a7-4f2bb2d14034 tempest-VolumesTransfersTest-1600948582 None] Lock "cinder-629e608b-ceec-49d7-b036-415158eb6c51-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:32 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.560s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:32 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Deleted volume successfully. Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-db0e6066-ed35-4fdb-9b2f-a8d33ba29e6e tempest-VolumesActionsTest-1383670629 None] Lock "cinder-0e477d34-2bda-4550-96f1-f7ef41877506-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Flow 'volume_create_manager' (f473c958-07e0-4c91-94fd-6872bc8a4016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977ca8e3-530d-4020-8382-8d422695a285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977ca8e3-530d-4020-8382-8d422695a285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1475274320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b1a354-6baa-4e5b-8df3-2d2587de07aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e342e7281fb64424a56c6c3a2684dd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:33Z,use_quota=True,user_id='b2fd92108144475697efdd862336ba05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b1df6e-d1db-4d26-b0ba-879bf303e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b1df6e-d1db-4d26-b0ba-879bf303e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d570b0e2-ae89-4311-9f8a-e3f7985e3155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d570b0e2-ae89-4311-9f8a-e3f7985e3155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b1a354-6baa-4e5b-8df3-2d2587de07aa', 'volume_name': 'volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5d47c2-e4b6-45d4-be9d-fda7bfe19b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5d47c2-e4b6-45d4-be9d-fda7bfe19b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02eecf4-5cbf-4ff0-92e6-9f4ecb5da9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:32 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Volume 49b1a354-6baa-4e5b-8df3-2d2587de07aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa', 'volume_size': 1} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1475274320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b1a354-6baa-4e5b-8df3-2d2587de07aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e342e7281fb64424a56c6c3a2684dd94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:33Z,use_quota=True,user_id='b2fd92108144475697efdd862336ba05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Creating volume 49b1a354-6baa-4e5b-8df3-2d2587de07aa {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:32 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:32 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa 1073741824 Apr 09 16:56:32 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:33 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa 1073741824" returned: 0 in 0.637s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:33 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa Apr 09 16:56:33 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:34 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa" returned: 0 in 0.543s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02eecf4-5cbf-4ff0-92e6-9f4ecb5da9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7008d4-b366-4d6a-bfb0-335906099c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:34 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Volume volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa (49b1a354-6baa-4e5b-8df3-2d2587de07aa): created successfully Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7008d4-b366-4d6a-bfb0-335906099c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Flow 'volume_create_manager' (f473c958-07e0-4c91-94fd-6872bc8a4016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:34 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-962eec2b-649d-459a-b567-6a88f662ed0e tempest-VolumesTransfersTest-1220002441 None] Created volume successfully. Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Flow 'volume_create_manager' (c5b11da3-9ebd-4eac-97db-4890e9b30c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7787da6d-6648-4d3b-ba4b-e60ee241d5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7787da6d-6648-4d3b-ba4b-e60ee241d5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1464617977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e037bd6a-8532-4ec4-9270-1c47eeffb18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d94f583f9184807be0d9047801bbba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:34Z,use_quota=True,user_id='b05ddcd98a1949e6876f8d0534b60f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80699867-7352-40cc-a512-cddf98eda10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80699867-7352-40cc-a512-cddf98eda10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8db7b5-ac9d-4f0b-9463-335db3f03399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8db7b5-ac9d-4f0b-9463-335db3f03399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e037bd6a-8532-4ec4-9270-1c47eeffb18a', 'volume_name': 'volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c399f763-72c5-40da-a512-d57addc7efc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c399f763-72c5-40da-a512-d57addc7efc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e81067-5c22-4b1f-a4cf-97d30da030f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:34 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Volume e037bd6a-8532-4ec4-9270-1c47eeffb18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a', 'volume_size': 1} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1464617977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e037bd6a-8532-4ec4-9270-1c47eeffb18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d94f583f9184807be0d9047801bbba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:34Z,use_quota=True,user_id='b05ddcd98a1949e6876f8d0534b60f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Creating volume e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:34 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:34 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a 1073741824 Apr 09 16:56:34 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:35 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a 1073741824" returned: 0 in 0.607s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:35 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a Apr 09 16:56:35 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Acquiring lock "cinder-49b1a354-6baa-4e5b-8df3-2d2587de07aa-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Lock "cinder-49b1a354-6baa-4e5b-8df3-2d2587de07aa-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Acquiring lock "cinder-quobyte-49b1a354-6baa-4e5b-8df3-2d2587de07aa" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Lock "cinder-quobyte-49b1a354-6baa-4e5b-8df3-2d2587de07aa" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39b005-f0b1-424f-801d-b96cfbc12b5e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:35 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa Apr 09 16:56:35 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:35 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a" returned: 0 in 0.475s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e81067-5c22-4b1f-a4cf-97d30da030f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e164a21-0820-4cbf-a10e-ca7fb568b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:35 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Volume volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a (e037bd6a-8532-4ec4-9270-1c47eeffb18a): created successfully Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e164a21-0820-4cbf-a10e-ca7fb568b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Flow 'volume_create_manager' (c5b11da3-9ebd-4eac-97db-4890e9b30c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:35 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8d6e96c2-3666-4e63-985a-5322dcb33212 tempest-VolumesCloneTest-698114123 None] Created volume successfully. Apr 09 16:56:35 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa" returned: 0 in 0.561s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:35 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa Apr 09 16:56:35 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:36 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-49b1a354-6baa-4e5b-8df3-2d2587de07aa" returned: 0 in 0.417s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Lock "cinder-quobyte-49b1a354-6baa-4e5b-8df3-2d2587de07aa" released by "delete_volume" :: held 1.001s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Created reservations ['796e21a3-42fd-4ce2-b2aa-890e7300b26b', '03003ab2-5e34-43a1-a437-b7d4d2c28eaf', '8c7245a9-49e3-4d10-bfde-006ec0ce6539', '94292c80-f766-4086-ad1f-2894d922763e'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:36 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:36 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:36 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.461s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Deleted volume successfully. Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d2fe1b5-fea8-4557-9d7d-2a56586b6c20 tempest-VolumesTransfersTest-1600948582 None] Lock "cinder-49b1a354-6baa-4e5b-8df3-2d2587de07aa-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Flow 'volume_create_manager' (5159dc5c-bf2e-4483-a0c0-ce55f9b90daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29f6246-83d9-48f0-bc48-d9ee35e39d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29f6246-83d9-48f0-bc48-d9ee35e39d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1782761582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f339bd6b-503c-4328-a5df-6ce482806cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d94f583f9184807be0d9047801bbba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e037bd6a-8532-4ec4-9270-1c47eeffb18a,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:37Z,use_quota=True,user_id='b05ddcd98a1949e6876f8d0534b60f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdec633c-0c50-43af-ad46-866229df4e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdec633c-0c50-43af-ad46-866229df4e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dd10a8-59c5-4b28-a483-5858927c3645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dd10a8-59c5-4b28-a483-5858927c3645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f339bd6b-503c-4328-a5df-6ce482806cf2', 'volume_name': 'volume-f339bd6b-503c-4328-a5df-6ce482806cf2', 'volume_size': 2, 'source_volid': 'e037bd6a-8532-4ec4-9270-1c47eeffb18a', 'source_volstatus': 'available'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebea894-adc6-46a3-aad2-abcaf163011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebea894-adc6-46a3-aad2-abcaf163011d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72762ecd-9f2d-4c8c-8323-92ef6601a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:36 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Volume f339bd6b-503c-4328-a5df-6ce482806cf2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f339bd6b-503c-4328-a5df-6ce482806cf2', 'volume_size': 2, 'source_volid': 'e037bd6a-8532-4ec4-9270-1c47eeffb18a', 'source_volstatus': 'available'} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:36 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Cloning volume e037bd6a-8532-4ec4-9270-1c47eeffb18a to volume f339bd6b-503c-4328-a5df-6ce482806cf2 Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Creating offline snapshot 81b328fe-7a09-4d39-85b1-1a26aaead7c4 of volume e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0721874f-bb89-43b7-bc23-0955afec746d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:37 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a Apr 09 16:56:37 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:37 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a" returned: 0 in 0.493s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:37 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 1G Apr 09 16:56:37 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:38 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 1G" returned: 0 in 0.587s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:38 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 Apr 09 16:56:38 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:38 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4" returned: 0 in 0.457s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:38 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 is being set with open permissions: ugo+rw Apr 09 16:56:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:38 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 Apr 09 16:56:38 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:38 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4" returned: 0 in 0.491s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:39 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.info Apr 09 16:56:39 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (412d5ac2-971f-40a5-bf80-0cd6c1d3d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b11c39-6c7b-4736-9859-570131a75d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b11c39-6c7b-4736-9859-570131a75d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302071129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b2f099-71d2-4852-9343-db1f9030630d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:39Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94dc1849-d6a4-437b-97d5-07f049a6c90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94dc1849-d6a4-437b-97d5-07f049a6c90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170d9e61-9518-4ed3-bd9f-5515b7e08c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170d9e61-9518-4ed3-bd9f-5515b7e08c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b2f099-71d2-4852-9343-db1f9030630d', 'volume_name': 'volume-c6b2f099-71d2-4852-9343-db1f9030630d', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16575f5c-6a1a-484a-8e04-7492fc6624d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16575f5c-6a1a-484a-8e04-7492fc6624d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ba9400-a03c-444e-8798-c8ef6d42f69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Volume c6b2f099-71d2-4852-9343-db1f9030630d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b2f099-71d2-4852-9343-db1f9030630d', 'volume_size': 1} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:39 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.info" returned: 0 in 0.463s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:39 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.info is being set with open permissions: ugo+rw Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:39 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.info Apr 09 16:56:39 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:39 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.info" returned: 0 in 0.493s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Acquiring lock "cinder-quobyte-f339bd6b-503c-4328-a5df-6ce482806cf2" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Lock "cinder-quobyte-f339bd6b-503c-4328-a5df-6ce482806cf2" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] snapshot: 81b328fe-7a09-4d39-85b1-1a26aaead7c4, volume: f339bd6b-503c-4328-a5df-6ce482806cf2, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b528d-813f-4586-af2a-c88b25f4d450]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:40 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 Apr 09 16:56:40 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:40 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4" returned: 0 in 0.512s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b9dbd3-9931-4bbf-97ab-994a6feb34ef]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:40 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a Apr 09 16:56:40 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:41 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a" returned: 0 in 0.503s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:41 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 Apr 09 16:56:41 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Flow 'volume_create_manager' (9d5ece6f-ba69-4707-a8e0-58c95c503684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09431d32-a08a-4a16-8f1c-1f9f92071007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09431d32-a08a-4a16-8f1c-1f9f92071007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-628404037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca96d8-7187-4c29-95df-e25c9d730cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2013b4c12914e88a73d35ce0abc5d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:41Z,use_quota=True,user_id='2a407b8478e941419cdc17db7d89579b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a471279-85c6-4972-ab2f-e85cb733e279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a471279-85c6-4972-ab2f-e85cb733e279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3299c01f-e35f-44bd-8f23-78ce539755a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3299c01f-e35f-44bd-8f23-78ce539755a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ca96d8-7187-4c29-95df-e25c9d730cfa', 'volume_name': 'volume-60ca96d8-7187-4c29-95df-e25c9d730cfa', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d52a3b2-cd49-466a-9386-0757228b8edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d52a3b2-cd49-466a-9386-0757228b8edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39865d8-2bfd-414d-a6a8-9c5fc15bee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:41 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Volume 60ca96d8-7187-4c29-95df-e25c9d730cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ca96d8-7187-4c29-95df-e25c9d730cfa', 'volume_size': 1} Apr 09 16:56:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:43 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2" returned: 0 in 2.015s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:43 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd44d31-9642-4f9f-9bf2-28e12c847d34]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:43 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a Apr 09 16:56:43 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:43 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a" returned: 0 in 0.587s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:43 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:56:43 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Converted 1024.00 MB image at 507.88 MB/s Apr 09 16:56:43 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 is being set with open permissions: ugo+rw Apr 09 16:56:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:43 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 Apr 09 16:56:43 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:44 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2" returned: 0 in 0.407s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Lock "cinder-quobyte-f339bd6b-503c-4328-a5df-6ce482806cf2" released by "_copy_volume_from_snapshot" :: held 4.075s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Acquiring lock "cinder-quobyte-81b328fe-7a09-4d39-85b1-1a26aaead7c4" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Lock "cinder-quobyte-81b328fe-7a09-4d39-85b1-1a26aaead7c4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Deleting offline snapshot 81b328fe-7a09-4d39-85b1-1a26aaead7c4 of volume e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] snapshot_file for this snap is: volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea61bb2-ee97-430a-8cf7-6d9405822db6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:44 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 Apr 09 16:56:44 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:44 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4" returned: 0 in 0.469s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c655ff6-80b9-46f0-8250-e7bf8cdd0323]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:44 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a Apr 09 16:56:44 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:45 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a" returned: 0 in 0.467s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:45 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 Apr 09 16:56:45 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:45 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4" returned: 0 in 0.439s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:45 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4 Apr 09 16:56:45 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:45 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a.81b328fe-7a09-4d39-85b1-1a26aaead7c4" returned: 0 in 0.411s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Lock "cinder-quobyte-81b328fe-7a09-4d39-85b1-1a26aaead7c4" released by "_delete_snapshot" :: held 1.839s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.033s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.589s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302071129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b2f099-71d2-4852-9343-db1f9030630d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:39Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Creating volume c6b2f099-71d2-4852-9343-db1f9030630d {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:45 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72762ecd-9f2d-4c8c-8323-92ef6601a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f339bd6b-503c-4328-a5df-6ce482806cf2', 'volume_size': 2, 'source_volid': 'e037bd6a-8532-4ec4-9270-1c47eeffb18a', 'source_volstatus': 'available'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:45 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d 1073741824 Apr 09 16:56:45 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7aa04f9-f27d-477f-ad6a-655a2f358deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:46 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Volume volume-f339bd6b-503c-4328-a5df-6ce482806cf2 (f339bd6b-503c-4328-a5df-6ce482806cf2): created successfully Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7aa04f9-f27d-477f-ad6a-655a2f358deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Flow 'volume_create_manager' (5159dc5c-bf2e-4483-a0c0-ce55f9b90daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:46 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a997ef7c-8133-4836-93a5-62374d1d94d9 tempest-VolumesCloneTest-698114123 None] Created volume successfully. Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Acquiring lock "cinder-f339bd6b-503c-4328-a5df-6ce482806cf2-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Lock "cinder-f339bd6b-503c-4328-a5df-6ce482806cf2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Acquiring lock "cinder-quobyte-f339bd6b-503c-4328-a5df-6ce482806cf2" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Lock "cinder-quobyte-f339bd6b-503c-4328-a5df-6ce482806cf2" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02ba1e1-f04b-4bc5-bf77-7d3d20617697]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:46 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d 1073741824" returned: 0 in 0.530s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:46 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 Apr 09 16:56:46 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:46 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d Apr 09 16:56:46 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:46 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2" returned: 0 in 0.489s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:46 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d" returned: 0 in 0.427s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.553s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-628404037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca96d8-7187-4c29-95df-e25c9d730cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2013b4c12914e88a73d35ce0abc5d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:41Z,use_quota=True,user_id='2a407b8478e941419cdc17db7d89579b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Creating volume 60ca96d8-7187-4c29-95df-e25c9d730cfa {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:46 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2 Apr 09 16:56:46 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:46 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ba9400-a03c-444e-8798-c8ef6d42f69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b2f099-71d2-4852-9343-db1f9030630d', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b2e132-0859-43c2-a871-d171263f49ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:46 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa 1073741824 Apr 09 16:56:46 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:47 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Volume volume-c6b2f099-71d2-4852-9343-db1f9030630d (c6b2f099-71d2-4852-9343-db1f9030630d): created successfully Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b2e132-0859-43c2-a871-d171263f49ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (412d5ac2-971f-40a5-bf80-0cd6c1d3d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:47 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6061c2df-84b9-423d-8e73-0e0697994a7c tempest-VolumesActionsTest-1383670629 None] Created volume successfully. Apr 09 16:56:47 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f339bd6b-503c-4328-a5df-6ce482806cf2" returned: 0 in 0.405s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Lock "cinder-quobyte-f339bd6b-503c-4328-a5df-6ce482806cf2" released by "delete_volume" :: held 0.921s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Created reservations ['d5fdcc8f-0a5d-4c05-9c1c-c6be769651a5', '86699111-4f23-428a-b494-756b02dc41b3', '1968e13f-f31f-4e76-967f-a5b1a7a33aa1', '49f57182-f093-42f4-b3db-4beebb6d9b18'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:47 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:47 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:47 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa 1073741824" returned: 0 in 0.498s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:47 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa Apr 09 16:56:47 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Acquiring lock "cinder-e037bd6a-8532-4ec4-9270-1c47eeffb18a-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Lock "cinder-e037bd6a-8532-4ec4-9270-1c47eeffb18a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Acquiring lock "cinder-quobyte-e037bd6a-8532-4ec4-9270-1c47eeffb18a" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Lock "cinder-quobyte-e037bd6a-8532-4ec4-9270-1c47eeffb18a" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d6487-e630-4305-86ba-1cff55b8b493]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:47 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a Apr 09 16:56:47 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:47 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:47 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Deleted volume successfully. Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-20390966-e503-4783-8235-6fb01c0671f0 tempest-VolumesCloneTest-698114123 None] Lock "cinder-f339bd6b-503c-4328-a5df-6ce482806cf2-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-c6b2f099-71d2-4852-9343-db1f9030630d-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Lock "cinder-c6b2f099-71d2-4852-9343-db1f9030630d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:47 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-quobyte-c6b2f099-71d2-4852-9343-db1f9030630d" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa" returned: 0 in 0.493s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39865d8-2bfd-414d-a6a8-9c5fc15bee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ca96d8-7187-4c29-95df-e25c9d730cfa', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3895a79f-1786-418e-8c9b-f9af9f58c41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Lock "cinder-quobyte-c6b2f099-71d2-4852-9343-db1f9030630d" acquired by "delete_volume" :: waited 0.027s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:48 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Volume volume-60ca96d8-7187-4c29-95df-e25c9d730cfa (60ca96d8-7187-4c29-95df-e25c9d730cfa): created successfully Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3895a79f-1786-418e-8c9b-f9af9f58c41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Flow 'volume_create_manager' (9d5ece6f-ba69-4707-a8e0-58c95c503684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d7bf0f-b98e-4eea-a39d-9addd165de7c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:48 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-09b0598c-0ac0-46f4-b956-1e7f487f6971 tempest-VolumesTransfersV355Test-935633800 None] Created volume successfully. Apr 09 16:56:48 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d Apr 09 16:56:48 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:48 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a" returned: 0 in 0.526s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:48 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a Apr 09 16:56:48 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:48 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d" returned: 0 in 0.488s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:48 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d Apr 09 16:56:48 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:48 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e037bd6a-8532-4ec4-9270-1c47eeffb18a" returned: 0 in 0.422s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Lock "cinder-quobyte-e037bd6a-8532-4ec4-9270-1c47eeffb18a" released by "delete_volume" :: held 0.980s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Created reservations ['2a0207fe-e90d-453f-9190-fb45ac607f39', 'f018e5c3-1e4c-42be-8fc3-915cfd7d7935', '7a54176f-7aa5-4d11-9d33-40f7913b8379', 'cd337984-645b-41e5-94eb-0832f3ee4b46'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:48 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:48 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:49 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-c6b2f099-71d2-4852-9343-db1f9030630d" returned: 0 in 0.503s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Lock "cinder-quobyte-c6b2f099-71d2-4852-9343-db1f9030630d" released by "delete_volume" :: held 1.023s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Created reservations ['4acea4cf-680a-4a64-a39e-24b16ba0b614', '7fba159b-f6ba-40aa-bfc1-68a9d54eb632', 'd171fec4-1cc8-4bc7-bc6a-e0b0fb5d8115', 'a255eba8-6c7b-4b9a-ab7f-63fc41530655'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:49 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:49 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:49 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.541s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:49 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Deleted volume successfully. Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1cfc1281-440a-4d9a-b38b-7110e760644a tempest-VolumesCloneTest-698114123 None] Lock "cinder-e037bd6a-8532-4ec4-9270-1c47eeffb18a-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:49 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-828503d5-392a-4e0a-ad28-880b680572e5 tempest-VolumesTransfersV355Test-1291965246 None] Transfer volume completed successfully. Apr 09 16:56:49 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.517s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:49 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Deleted volume successfully. Apr 09 16:56:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1812a44c-ab8d-4f44-834b-c1084d628cbc tempest-VolumesActionsTest-2013493775 None] Lock "cinder-c6b2f099-71d2-4852-9343-db1f9030630d-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Acquiring lock "cinder-60ca96d8-7187-4c29-95df-e25c9d730cfa-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Lock "cinder-60ca96d8-7187-4c29-95df-e25c9d730cfa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Acquiring lock "cinder-quobyte-60ca96d8-7187-4c29-95df-e25c9d730cfa" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Lock "cinder-quobyte-60ca96d8-7187-4c29-95df-e25c9d730cfa" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9134df-b071-48df-888b-149df353a33c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (e5542a48-04ed-41f0-82fa-a3ee69121f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4adbde5-ecf5-4c17-9284-e92c297d376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4adbde5-ecf5-4c17-9284-e92c297d376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108712957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2dea43-2c71-4c37-b58e-9c743efbc0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:50Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8439077a-ed3b-4e9c-b8e0-04a20eb8a305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8439077a-ed3b-4e9c-b8e0-04a20eb8a305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea96a7a5-3069-4934-beb8-98ad1410e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea96a7a5-3069-4934-beb8-98ad1410e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2dea43-2c71-4c37-b58e-9c743efbc0c6', 'volume_name': 'volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:50 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa Apr 09 16:56:50 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725ae195-3c87-4cc8-a9d1-1c9ec9fd0de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725ae195-3c87-4cc8-a9d1-1c9ec9fd0de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4b907f-e7c2-4fb8-a90e-d9adda56517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Volume 6f2dea43-2c71-4c37-b58e-9c743efbc0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6', 'volume_size': 1} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108712957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2dea43-2c71-4c37-b58e-9c743efbc0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:50Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Creating volume 6f2dea43-2c71-4c37-b58e-9c743efbc0c6 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:50 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:50 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 1073741824 Apr 09 16:56:50 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (6a12ee36-47ce-4ab0-8ea8-1e9ad954bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef27b51e-44c3-4d2d-babd-f99f4f206300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef27b51e-44c3-4d2d-babd-f99f4f206300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-902701344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998efe16-7964-4f15-98a2-fa7018aced5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:51Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4ce8d4-533f-420d-b078-9e6348ff718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4ce8d4-533f-420d-b078-9e6348ff718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eed9563-9b19-4afa-b570-efe09e58d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eed9563-9b19-4afa-b570-efe09e58d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998efe16-7964-4f15-98a2-fa7018aced5f', 'volume_name': 'volume-998efe16-7964-4f15-98a2-fa7018aced5f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ed893c-7cbb-4cab-b028-6a79f52884f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ed893c-7cbb-4cab-b028-6a79f52884f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747a743b-e4a4-4985-a9f7-e32d11eba6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:50 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Volume 998efe16-7964-4f15-98a2-fa7018aced5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998efe16-7964-4f15-98a2-fa7018aced5f', 'volume_size': 1} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:50 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa" returned: 0 in 0.575s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:51 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa Apr 09 16:56:51 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:51 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 1073741824" returned: 0 in 0.495s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:51 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 Apr 09 16:56:51 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:51 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-60ca96d8-7187-4c29-95df-e25c9d730cfa" returned: 0 in 0.432s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Lock "cinder-quobyte-60ca96d8-7187-4c29-95df-e25c9d730cfa" released by "delete_volume" :: held 1.042s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Created reservations ['c1878b6b-7789-49be-aa3f-aaadeeecddbc', 'd128e456-542b-421b-83d5-befbda715c2a', 'e242be82-e3a3-499d-9e99-0afabf4e20bc', '2b4c08a5-dfa8-42c3-be37-ea6da18bbd58'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:51 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6" returned: 0 in 0.439s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-902701344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998efe16-7964-4f15-98a2-fa7018aced5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:51Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Creating volume 998efe16-7964-4f15-98a2-fa7018aced5f {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:51 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:51 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f 1073741824 Apr 09 16:56:51 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4b907f-e7c2-4fb8-a90e-d9adda56517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2231a549-0ba3-4ade-b84a-c47b6acef2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:51 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Volume volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 (6f2dea43-2c71-4c37-b58e-9c743efbc0c6): created successfully Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2231a549-0ba3-4ade-b84a-c47b6acef2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:51 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:51 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (e5542a48-04ed-41f0-82fa-a3ee69121f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-accbc1e8-91b5-46eb-957f-2cae91f95f93 tempest-VolumesActionsTest-1383670629 None] Created volume successfully. Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Flow 'volume_create_manager' (7a4efbbe-a0de-497e-b5c2-70b733c91bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118c3647-b227-44ed-83d2-d068622906c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118c3647-b227-44ed-83d2-d068622906c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-848728803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ff920d-a28c-4188-a004-8ab0e75cb3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2013b4c12914e88a73d35ce0abc5d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:52Z,use_quota=True,user_id='2a407b8478e941419cdc17db7d89579b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd88049-aebb-475e-a587-039e5ce811ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd88049-aebb-475e-a587-039e5ce811ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f22384-07e6-4ca4-aa57-8b6af9eb484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f22384-07e6-4ca4-aa57-8b6af9eb484e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ff920d-a28c-4188-a004-8ab0e75cb3c3', 'volume_name': 'volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8eb8b1d-0678-4bfd-82e9-97363e6430f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8eb8b1d-0678-4bfd-82e9-97363e6430f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5ae5e5-ce5e-4b43-813f-2a87c0ddd197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:51 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Volume 15ff920d-a28c-4188-a004-8ab0e75cb3c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3', 'volume_size': 1} Apr 09 16:56:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:52 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f 1073741824" returned: 0 in 0.502s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:52 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:52 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f Apr 09 16:56:52 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.488s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Deleted volume successfully. Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9146f0e-d75c-4c5c-a80e-3f477231c809 tempest-VolumesTransfersV355Test-789292020 None] Lock "cinder-60ca96d8-7187-4c29-95df-e25c9d730cfa-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:52 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f" returned: 0 in 0.395s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-848728803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ff920d-a28c-4188-a004-8ab0e75cb3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2013b4c12914e88a73d35ce0abc5d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:52Z,use_quota=True,user_id='2a407b8478e941419cdc17db7d89579b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Creating volume 15ff920d-a28c-4188-a004-8ab0e75cb3c3 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:52 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747a743b-e4a4-4985-a9f7-e32d11eba6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998efe16-7964-4f15-98a2-fa7018aced5f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc2c11c-2167-4dc3-b0ba-0ed9b52896a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:52 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 1073741824 Apr 09 16:56:52 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:52 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Volume volume-998efe16-7964-4f15-98a2-fa7018aced5f (998efe16-7964-4f15-98a2-fa7018aced5f): created successfully Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc2c11c-2167-4dc3-b0ba-0ed9b52896a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (6a12ee36-47ce-4ab0-8ea8-1e9ad954bb79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c5f4ee2f-f76c-45b2-b18c-fee50fb0259b tempest-VolumesGetTest-1337512028 None] Created volume successfully. Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-6f2dea43-2c71-4c37-b58e-9c743efbc0c6-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Lock "cinder-6f2dea43-2c71-4c37-b58e-9c743efbc0c6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-quobyte-6f2dea43-2c71-4c37-b58e-9c743efbc0c6" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Lock "cinder-quobyte-6f2dea43-2c71-4c37-b58e-9c743efbc0c6" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b418f0ac-2708-49ba-af7d-8e9f225f8b36]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:52 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 Apr 09 16:56:52 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:52 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 1073741824" returned: 0 in 0.513s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:52 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 Apr 09 16:56:52 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (d30971e7-bc63-4dc1-af22-9cef709b1947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191be5b1-7f88-4da2-9770-f45a7cc00fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191be5b1-7f88-4da2-9770-f45a7cc00fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-174257316',display_name='tempest-VolumesGetTest-Volume-259984925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cac141-7bce-495b-bea8-5c29f175a45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:53Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed438315-fd60-4335-a8fe-0af38966f268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed438315-fd60-4335-a8fe-0af38966f268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0def8edb-75e8-4770-961a-9bfc1494cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0def8edb-75e8-4770-961a-9bfc1494cafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05cac141-7bce-495b-bea8-5c29f175a45f', 'volume_name': 'volume-05cac141-7bce-495b-bea8-5c29f175a45f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd858c94-8ad7-417f-a605-4cc0270a964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd858c94-8ad7-417f-a605-4cc0270a964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d317e3-91fc-4a4e-b054-b31c5bb1e56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:53 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Volume 05cac141-7bce-495b-bea8-5c29f175a45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05cac141-7bce-495b-bea8-5c29f175a45f', 'volume_size': 1} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:53 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6" returned: 0 in 0.608s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:53 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6 Apr 09 16:56:53 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:53 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3" returned: 0 in 0.450s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-174257316',display_name='tempest-VolumesGetTest-Volume-259984925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cac141-7bce-495b-bea8-5c29f175a45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:53Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Creating volume 05cac141-7bce-495b-bea8-5c29f175a45f {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:53 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5ae5e5-ce5e-4b43-813f-2a87c0ddd197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb25f7b-3a9a-4c95-aacc-5c8b7a7215e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:53 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f 1073741824 Apr 09 16:56:53 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:53 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Volume volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 (15ff920d-a28c-4188-a004-8ab0e75cb3c3): created successfully Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb25f7b-3a9a-4c95-aacc-5c8b7a7215e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Flow 'volume_create_manager' (7a4efbbe-a0de-497e-b5c2-70b733c91bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:53 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-96096cf5-f443-4cce-9d4d-32b5d84d0b73 tempest-VolumesTransfersV355Test-935633800 None] Created volume successfully. Apr 09 16:56:53 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6f2dea43-2c71-4c37-b58e-9c743efbc0c6" returned: 0 in 0.408s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Lock "cinder-quobyte-6f2dea43-2c71-4c37-b58e-9c743efbc0c6" released by "delete_volume" :: held 1.037s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Created reservations ['d84e8911-19b7-4c4a-b5e0-64edaf359506', 'ce3cbecd-e942-4f1d-b42d-9c26d97c4e7a', '22b5e6d4-5b3a-46e3-b607-8b7a8d48ad3f', '718ff502-0cfb-4bd8-a7d6-5770f3038660'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:53 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:53 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:53 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f 1073741824" returned: 0 in 0.523s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:54 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f Apr 09 16:56:54 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Acquiring lock "cinder-15ff920d-a28c-4188-a004-8ab0e75cb3c3-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Lock "cinder-15ff920d-a28c-4188-a004-8ab0e75cb3c3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Acquiring lock "cinder-quobyte-15ff920d-a28c-4188-a004-8ab0e75cb3c3" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Lock "cinder-quobyte-15ff920d-a28c-4188-a004-8ab0e75cb3c3" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[51903504-0cd0-404f-b0a5-8da5c8615915]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:54 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.458s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Deleted volume successfully. Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-0bdaf44d-8fd4-4c8c-b0e8-35710e8964ac tempest-VolumesActionsTest-2013493775 None] Lock "cinder-6f2dea43-2c71-4c37-b58e-9c743efbc0c6-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:54 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 Apr 09 16:56:54 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:54 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f" returned: 0 in 0.484s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d317e3-91fc-4a4e-b054-b31c5bb1e56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05cac141-7bce-495b-bea8-5c29f175a45f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fd19bc-03a8-4cab-bb2f-0336eab6549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:54 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Volume volume-05cac141-7bce-495b-bea8-5c29f175a45f (05cac141-7bce-495b-bea8-5c29f175a45f): created successfully Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fd19bc-03a8-4cab-bb2f-0336eab6549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (d30971e7-bc63-4dc1-af22-9cef709b1947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-b8a962ad-6232-4f1d-b1e7-5ece240c1c11 tempest-VolumesGetTest-1337512028 None] Created volume successfully. Apr 09 16:56:54 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3" returned: 0 in 0.482s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:54 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3 Apr 09 16:56:54 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (3a101f63-6b96-4f1c-be05-99a3ad326f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcb9db0-70b3-44d1-a7f4-6242b696b020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcb9db0-70b3-44d1-a7f4-6242b696b020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1220849168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557b9987-a878-43cf-acd3-733854a42232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:55Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d1cf4c-1703-4707-8267-4a1f142364ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d1cf4c-1703-4707-8267-4a1f142364ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30507245-44cc-4246-a7bc-f24969947f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30507245-44cc-4246-a7bc-f24969947f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557b9987-a878-43cf-acd3-733854a42232', 'volume_name': 'volume-557b9987-a878-43cf-acd3-733854a42232', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89188716-0d73-42c2-b9e6-75db46957156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89188716-0d73-42c2-b9e6-75db46957156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c1772a-6729-4ec2-8f50-91e68f5a7090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:55 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Volume 557b9987-a878-43cf-acd3-733854a42232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557b9987-a878-43cf-acd3-733854a42232', 'volume_size': 1} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1220849168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557b9987-a878-43cf-acd3-733854a42232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:55Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Creating volume 557b9987-a878-43cf-acd3-733854a42232 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:55 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:55 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 1073741824 Apr 09 16:56:55 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:55 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-15ff920d-a28c-4188-a004-8ab0e75cb3c3" returned: 0 in 0.479s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Lock "cinder-quobyte-15ff920d-a28c-4188-a004-8ab0e75cb3c3" released by "delete_volume" :: held 0.982s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Created reservations ['20c00eb3-b104-44a6-ac52-fa4e12db6853', '7b3b1f83-a19d-4813-acae-d20efed9ffe2', '5d0b8707-3b54-4c05-bcf0-ec6dd12ff634', 'c101af7e-af15-4576-bd7c-96afa9a8450c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:55 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:55 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-05cac141-7bce-495b-bea8-5c29f175a45f-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Lock "cinder-05cac141-7bce-495b-bea8-5c29f175a45f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-05cac141-7bce-495b-bea8-5c29f175a45f" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-05cac141-7bce-495b-bea8-5c29f175a45f" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c3b673-62c5-4ee8-9f82-757989f80180]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:55 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f Apr 09 16:56:55 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:55 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 1073741824" returned: 0 in 0.534s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:55 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 Apr 09 16:56:55 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:55 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.465s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:55 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Deleted volume successfully. Apr 09 16:56:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-85ae7c10-6939-41e7-9057-0e2298754fd3 tempest-VolumesTransfersV355Test-789292020 None] Lock "cinder-15ff920d-a28c-4188-a004-8ab0e75cb3c3-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:56 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f" returned: 0 in 0.498s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:56 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f Apr 09 16:56:56 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:56 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232" returned: 0 in 0.434s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c1772a-6729-4ec2-8f50-91e68f5a7090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557b9987-a878-43cf-acd3-733854a42232', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb104bf-565c-4e61-8f7e-99eb48f8387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:56 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Volume volume-557b9987-a878-43cf-acd3-733854a42232 (557b9987-a878-43cf-acd3-733854a42232): created successfully Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb104bf-565c-4e61-8f7e-99eb48f8387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (3a101f63-6b96-4f1c-be05-99a3ad326f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:56 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-531a233a-fa6f-4de3-8176-ea0dcfd35239 tempest-VolumesActionsTest-1383670629 None] Created volume successfully. Apr 09 16:56:56 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-05cac141-7bce-495b-bea8-5c29f175a45f" returned: 0 in 0.445s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-05cac141-7bce-495b-bea8-5c29f175a45f" released by "delete_volume" :: held 0.964s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Created reservations ['ca235fb0-2fd7-4f4a-8a1d-ad78a4077115', '482c3bbe-4cf8-479d-b0a5-c1f8292a4150', 'd849fa85-6fc3-4733-aedd-017a34201d4d', '99982a45-4e10-4827-bd96-b008fdc03902'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:56 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:56 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-998efe16-7964-4f15-98a2-fa7018aced5f-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Lock "cinder-998efe16-7964-4f15-98a2-fa7018aced5f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-998efe16-7964-4f15-98a2-fa7018aced5f" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-998efe16-7964-4f15-98a2-fa7018aced5f" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb02e0f8-c80a-4f77-8c64-0cb061ebe1e4]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:56 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f Apr 09 16:56:56 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:57 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.452s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:57 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Deleted volume successfully. Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-29ff5ea7-317e-4eb6-b136-3c93743579a2 tempest-VolumesGetTest-1337512028 None] Lock "cinder-05cac141-7bce-495b-bea8-5c29f175a45f-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:57 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f" returned: 0 in 0.586s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-557b9987-a878-43cf-acd3-733854a42232-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:57 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f Apr 09 16:56:57 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Lock "cinder-557b9987-a878-43cf-acd3-733854a42232-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-quobyte-557b9987-a878-43cf-acd3-733854a42232" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Lock "cinder-quobyte-557b9987-a878-43cf-acd3-733854a42232" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[30547ea5-9220-4b24-a4c1-1a87469d201f]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:57 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 Apr 09 16:56:57 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:57 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998efe16-7964-4f15-98a2-fa7018aced5f" returned: 0 in 0.476s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-998efe16-7964-4f15-98a2-fa7018aced5f" released by "delete_volume" :: held 1.088s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Created reservations ['f0a3b59d-ac4f-462f-99bd-0716965fa103', 'f45d2384-02f3-45e5-ace2-9b6bade1aa66', '42b5af27-8d82-49ab-bc8a-215051bbb876', 'c4e1e504-fb81-4a19-8970-d10a99fa82bf'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:57 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:57 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:57 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232" returned: 0 in 0.541s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:57 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232 Apr 09 16:56:57 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:58 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.440s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:58 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Deleted volume successfully. Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-803e31c4-0f71-4140-8503-65a617648426 tempest-VolumesGetTest-1337512028 None] Lock "cinder-998efe16-7964-4f15-98a2-fa7018aced5f-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:58 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-557b9987-a878-43cf-acd3-733854a42232" returned: 0 in 0.458s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Lock "cinder-quobyte-557b9987-a878-43cf-acd3-733854a42232" released by "delete_volume" :: held 1.023s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Created reservations ['ce3216e9-15fd-4766-ad84-3527d8e8df6b', '8cc4258a-c34a-4abc-a52a-8620a0f4cfbe', '91dd04f6-fed4-4a72-8f87-263ecb927929', 'e723810a-cf2a-4928-8ea5-1a9b4ff012a6'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:58 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:56:58 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:58 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.438s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:56:58 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Deleted volume successfully. Apr 09 16:56:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-deccdee4-d79e-4880-9ec1-0be29cb67a46 tempest-VolumesActionsTest-2013493775 None] Lock "cinder-557b9987-a878-43cf-acd3-733854a42232-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (1a9fa58d-e65a-4180-ab24-e770ac25d130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c91741-a08d-467d-ad92-d694f4a30ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c91741-a08d-467d-ad92-d694f4a30ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1211032413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b60238-23f7-4c84-8737-cc45bf58a3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:59Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72f046c-c9b7-4366-a383-db4b9e7c5004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72f046c-c9b7-4366-a383-db4b9e7c5004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241aa112-1409-48c2-afa3-e209714707e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241aa112-1409-48c2-afa3-e209714707e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b60238-23f7-4c84-8737-cc45bf58a3a3', 'volume_name': 'volume-71b60238-23f7-4c84-8737-cc45bf58a3a3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de1fb44-32be-4c29-8984-551af47392de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de1fb44-32be-4c29-8984-551af47392de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a76fad-26b5-485f-bb4b-e61114be2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Volume 71b60238-23f7-4c84-8737-cc45bf58a3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b60238-23f7-4c84-8737-cc45bf58a3a3', 'volume_size': 1} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1211032413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b60238-23f7-4c84-8737-cc45bf58a3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:56:59Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Creating volume 71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:56:59 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:59 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 1073741824 Apr 09 16:56:59 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:59 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 1073741824" returned: 0 in 0.522s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:56:59 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 Apr 09 16:56:59 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (13bb464a-87d1-4b91-8a16-d1ba4a9cad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07f8ef7-6d4e-4787-a08d-ea006ac777e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07f8ef7-6d4e-4787-a08d-ea006ac777e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252102073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96c94ed-1541-4d31-862d-d1588f03c420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:00Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e253fac-e7aa-4fe1-aeb2-dea60f9d6169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e253fac-e7aa-4fe1-aeb2-dea60f9d6169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13ce40a-8962-42bf-ac39-ccc6affa1b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13ce40a-8962-42bf-ac39-ccc6affa1b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96c94ed-1541-4d31-862d-d1588f03c420', 'volume_name': 'volume-b96c94ed-1541-4d31-862d-d1588f03c420', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a581e08-b5fc-4bf0-8ea8-982a432015c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a581e08-b5fc-4bf0-8ea8-982a432015c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa1b524-6dad-4dce-8fae-28342d26282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:56:59 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Volume b96c94ed-1541-4d31-862d-d1588f03c420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96c94ed-1541-4d31-862d-d1588f03c420', 'volume_size': 1} Apr 09 16:56:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:00 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3" returned: 0 in 0.448s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252102073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96c94ed-1541-4d31-862d-d1588f03c420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:00Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Creating volume b96c94ed-1541-4d31-862d-d1588f03c420 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:00 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a76fad-26b5-485f-bb4b-e61114be2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b60238-23f7-4c84-8737-cc45bf58a3a3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0b286c-a7a5-4814-8053-5d4f8d3dd3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:00 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 1073741824 Apr 09 16:57:00 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:00 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Volume volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 (71b60238-23f7-4c84-8737-cc45bf58a3a3): created successfully Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0b286c-a7a5-4814-8053-5d4f8d3dd3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (1a9fa58d-e65a-4180-ab24-e770ac25d130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:00 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-200fc6da-c4de-4207-a0a6-eb9229179232 tempest-VolumesGetTest-1337512028 None] Created volume successfully. Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Flow 'volume_create_manager' (f612f44f-4c2e-4e32-8ebd-521f06564fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65bd2898-6533-4ed9-9891-fe753ecf63e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65bd2898-6533-4ed9-9891-fe753ecf63e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1581751373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4337ee3f-4fd7-48c0-a92a-821063d3c5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ae67b433f54e9b8a359569af6f6d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:01Z,use_quota=True,user_id='c642365188b64e24b2a2117a1e493377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405dfdf4-f3d6-4749-a735-c075b3d8dd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405dfdf4-f3d6-4749-a735-c075b3d8dd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9765c954-b162-4ef6-8387-2649e901cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9765c954-b162-4ef6-8387-2649e901cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4337ee3f-4fd7-48c0-a92a-821063d3c5b8', 'volume_name': 'volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48c7fa8-1736-45be-b3e2-2e6401c76c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48c7fa8-1736-45be-b3e2-2e6401c76c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542eb10c-c745-46c8-8f50-f5b23623ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:00 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Volume 4337ee3f-4fd7-48c0-a92a-821063d3c5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8', 'volume_size': 1} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:00 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 1073741824" returned: 0 in 0.544s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:00 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 Apr 09 16:57:00 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:01 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420" returned: 0 in 0.422s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1581751373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4337ee3f-4fd7-48c0-a92a-821063d3c5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ae67b433f54e9b8a359569af6f6d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:01Z,use_quota=True,user_id='c642365188b64e24b2a2117a1e493377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Creating volume 4337ee3f-4fd7-48c0-a92a-821063d3c5b8 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:01 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa1b524-6dad-4dce-8fae-28342d26282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96c94ed-1541-4d31-862d-d1588f03c420', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4771dd-2823-45b3-9582-18224a3f733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:01 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 1073741824 Apr 09 16:57:01 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:01 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Volume volume-b96c94ed-1541-4d31-862d-d1588f03c420 (b96c94ed-1541-4d31-862d-d1588f03c420): created successfully Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4771dd-2823-45b3-9582-18224a3f733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (13bb464a-87d1-4b91-8a16-d1ba4a9cad8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:01 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-40ebb63f-a6d8-46a7-a59e-29b9fe07ea4e tempest-VolumesActionsTest-1383670629 None] Created volume successfully. Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (2f1c8001-1751-4588-b15e-7f8c58ae9d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25635377-d4c3-450d-91e2-9fce70dce9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25635377-d4c3-450d-91e2-9fce70dce9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1778478813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcfa8ad-21f1-459e-b512-0988fff2e2fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=71b60238-23f7-4c84-8737-cc45bf58a3a3,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:01Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe121e9-35f1-43dc-8b8d-55c44c620272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe121e9-35f1-43dc-8b8d-55c44c620272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d5e603-5982-4028-ab03-ba2460b2d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d5e603-5982-4028-ab03-ba2460b2d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0fcfa8ad-21f1-459e-b512-0988fff2e2fd', 'volume_name': 'volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd', 'volume_size': 1, 'source_volid': '71b60238-23f7-4c84-8737-cc45bf58a3a3', 'source_volstatus': 'available'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f06d27-7b5d-4bfe-8347-533e2be9563e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f06d27-7b5d-4bfe-8347-533e2be9563e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc89c73-ea32-4b2c-b1e4-40e286432e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:01 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Volume 0fcfa8ad-21f1-459e-b512-0988fff2e2fd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd', 'volume_size': 1, 'source_volid': '71b60238-23f7-4c84-8737-cc45bf58a3a3', 'source_volstatus': 'available'} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:01 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 1073741824" returned: 0 in 0.526s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:01 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 Apr 09 16:57:01 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-b96c94ed-1541-4d31-862d-d1588f03c420-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Lock "cinder-b96c94ed-1541-4d31-862d-d1588f03c420-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Acquiring lock "cinder-quobyte-b96c94ed-1541-4d31-862d-d1588f03c420" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Lock "cinder-quobyte-b96c94ed-1541-4d31-862d-d1588f03c420" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b758e48c-30bd-4fbd-b7e7-32b93d74957e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:02 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 Apr 09 16:57:02 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:02 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8" returned: 0 in 0.430s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.615s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:02 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Cloning volume 71b60238-23f7-4c84-8737-cc45bf58a3a3 to volume 0fcfa8ad-21f1-459e-b512-0988fff2e2fd Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542eb10c-c745-46c8-8f50-f5b23623ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712b848c-000c-43ef-a223-fce07593f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Creating offline snapshot 31152c61-e4e4-4b6d-912b-753f7ebeb561 of volume 71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:57:02 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Volume volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 (4337ee3f-4fd7-48c0-a92a-821063d3c5b8): created successfully Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712b848c-000c-43ef-a223-fce07593f69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Flow 'volume_create_manager' (f612f44f-4c2e-4e32-8ebd-521f06564fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[1017e572-771d-43f4-833a-b490542d8e1f]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-169a1043-b937-4529-848d-701ed5ebee44 tempest-VolumesTransfersV357Test-1431774785 None] Created volume successfully. Apr 09 16:57:02 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 Apr 09 16:57:02 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:02 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420" returned: 0 in 0.476s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:02 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420 Apr 09 16:57:02 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:02 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3" returned: 0 in 0.487s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:02 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 1G Apr 09 16:57:02 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:02 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b96c94ed-1541-4d31-862d-d1588f03c420" returned: 0 in 0.460s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Lock "cinder-quobyte-b96c94ed-1541-4d31-862d-d1588f03c420" released by "delete_volume" :: held 0.958s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Created reservations ['0af7bbb9-5906-4f1b-a346-222c3db921df', 'd6c8882e-e60a-4591-bbaf-c8f085908de8', '7b4c1e64-1bb6-4a60-9ed0-8293f915f048', 'e6e321b9-6d34-44c1-b67a-4fae8dadfefb'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:03 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:03 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-47005eb8-d98c-4fa8-a387-18f4da20655a tempest-VolumesTransfersV357Test-671855002 None] Transfer volume completed successfully. Apr 09 16:57:03 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 1G" returned: 0 in 0.555s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:03 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 Apr 09 16:57:03 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (1a8ca445-f66e-4a44-8437-79aa0888314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095af1f2-8982-48f7-880d-cdc87ef243e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095af1f2-8982-48f7-880d-cdc87ef243e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1668583957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71069b65-67e8-4fa7-9566-941b6f770c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:03Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166740c9-fa7d-45f1-95be-8a35e3c6897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166740c9-fa7d-45f1-95be-8a35e3c6897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9b16a1-9deb-4968-8f03-2532675cdd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9b16a1-9deb-4968-8f03-2532675cdd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71069b65-67e8-4fa7-9566-941b6f770c3f', 'volume_name': 'volume-71069b65-67e8-4fa7-9566-941b6f770c3f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62a25f9-bbfa-461a-baf6-eb742a17d1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62a25f9-bbfa-461a-baf6-eb742a17d1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d95226-62ba-4fe6-9f99-4176fbb2def7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:03 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Volume 71069b65-67e8-4fa7-9566-941b6f770c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71069b65-67e8-4fa7-9566-941b6f770c3f', 'volume_size': 1} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:03 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.501s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Deleted volume successfully. Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5f903f11-0fd8-4cd7-a4ed-c5558c599fab tempest-VolumesActionsTest-2013493775 None] Lock "cinder-b96c94ed-1541-4d31-862d-d1588f03c420-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:03 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:03 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 is being set with open permissions: ugo+rw Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:03 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 Apr 09 16:57:03 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Acquiring lock "cinder-4337ee3f-4fd7-48c0-a92a-821063d3c5b8-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Lock "cinder-4337ee3f-4fd7-48c0-a92a-821063d3c5b8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Acquiring lock "cinder-quobyte-4337ee3f-4fd7-48c0-a92a-821063d3c5b8" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Lock "cinder-quobyte-4337ee3f-4fd7-48c0-a92a-821063d3c5b8" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a071ed0-8f47-4d59-9f13-744c37ebc4c4]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:03 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 Apr 09 16:57:03 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:04 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561" returned: 0 in 0.424s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:04 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.info Apr 09 16:57:04 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:04 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8" returned: 0 in 0.497s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:04 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8 Apr 09 16:57:04 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:04 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.info" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:04 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.info is being set with open permissions: ugo+rw Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:04 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.info Apr 09 16:57:04 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:04 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4337ee3f-4fd7-48c0-a92a-821063d3c5b8" returned: 0 in 0.422s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Lock "cinder-quobyte-4337ee3f-4fd7-48c0-a92a-821063d3c5b8" released by "delete_volume" :: held 0.947s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Created reservations ['f7d61039-6433-48e3-944b-858f197d7e23', '38d83c09-d034-4941-be85-3d169bde18a5', '7d5f1607-055e-4186-a193-1e5d88c3ab5f', '9b88be7b-1eb6-4f7b-92c0-6fa7b4d97e0a'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:04 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:04 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:05 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.info" returned: 0 in 0.461s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] snapshot: 31152c61-e4e4-4b6d-912b-753f7ebeb561, volume: 0fcfa8ad-21f1-459e-b512-0988fff2e2fd, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7a4a8c-2a99-43d2-99c5-e57ac53f44ee]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:05 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 Apr 09 16:57:05 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Flow 'volume_create_manager' (a8ffe95f-e565-447a-82b0-f02f9231ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be7de32-a713-46fa-bdf2-b10b244ea892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be7de32-a713-46fa-bdf2-b10b244ea892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2134922221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840b98ce-ed6b-4dd2-b143-a50f165ce7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ae67b433f54e9b8a359569af6f6d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:05Z,use_quota=True,user_id='c642365188b64e24b2a2117a1e493377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07df398-10a6-433c-8859-1f82dc25ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07df398-10a6-433c-8859-1f82dc25ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc73060-b766-43da-b3fa-0d1b3a6f0437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc73060-b766-43da-b3fa-0d1b3a6f0437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840b98ce-ed6b-4dd2-b143-a50f165ce7ca', 'volume_name': 'volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d3e515-f2f6-405f-8276-b80a4586e452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d3e515-f2f6-405f-8276-b80a4586e452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822be6de-b7a4-4bfa-b255-4e91e141be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:05 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Volume 840b98ce-ed6b-4dd2-b143-a50f165ce7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca', 'volume_size': 1} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:05 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:05 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Deleted volume successfully. Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8f860e2-bc15-4ff5-b75f-ca6d6e6c69f4 tempest-VolumesTransfersV357Test-434806550 None] Lock "cinder-4337ee3f-4fd7-48c0-a92a-821063d3c5b8-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:05 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561" returned: 0 in 0.473s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b60238-23f7-4c84-8737-cc45bf58a3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6debe3c-34e2-496c-b763-4acfdd54130d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:05 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 Apr 09 16:57:05 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:06 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:06 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:57:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:06 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd Apr 09 16:57:06 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:08 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" returned: 0 in 2.071s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:08 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c3aa6-f0b1-43d9-9e46-a4221c590dbb]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:08 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 Apr 09 16:57:08 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:08 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3" returned: 0 in 0.600s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:08 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:57:08 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Converted 1024.00 MB image at 494.15 MB/s Apr 09 16:57:08 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd is being set with open permissions: ugo+rw Apr 09 16:57:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:08 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd Apr 09 16:57:08 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:09 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" returned: 0 in 0.414s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" released by "_copy_volume_from_snapshot" :: held 4.090s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-31152c61-e4e4-4b6d-912b-753f7ebeb561" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-31152c61-e4e4-4b6d-912b-753f7ebeb561" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Deleting offline snapshot 31152c61-e4e4-4b6d-912b-753f7ebeb561 of volume 71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] snapshot_file for this snap is: volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d028291-431e-487a-965b-87344bfce138]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:09 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 Apr 09 16:57:09 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:09 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561" returned: 0 in 0.474s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b60238-23f7-4c84-8737-cc45bf58a3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[67510e92-7be5-4ecf-908b-b00a03c3f585]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:09 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 Apr 09 16:57:09 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:10 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3" returned: 0 in 0.467s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:10 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 Apr 09 16:57:10 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:10 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561" returned: 0 in 0.450s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:10 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561 Apr 09 16:57:10 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:11 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3.31152c61-e4e4-4b6d-912b-753f7ebeb561" returned: 0 in 0.446s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-31152c61-e4e4-4b6d-912b-753f7ebeb561" released by "_delete_snapshot" :: held 1.882s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.968s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.698s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1668583957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71069b65-67e8-4fa7-9566-941b6f770c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cd0594aa71466cb7d358e44570564b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:03Z,use_quota=True,user_id='5ee29c1cacd64bbab18ea5db51f907ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Creating volume 71069b65-67e8-4fa7-9566-941b6f770c3f {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:11 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc89c73-ea32-4b2c-b1e4-40e286432e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd', 'volume_size': 1, 'source_volid': '71b60238-23f7-4c84-8737-cc45bf58a3a3', 'source_volstatus': 'available'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:11 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f 1073741824 Apr 09 16:57:11 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfee9b4-a558-4486-91b2-a3511688116a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:11 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Volume volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd (0fcfa8ad-21f1-459e-b512-0988fff2e2fd): created successfully Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfee9b4-a558-4486-91b2-a3511688116a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (2f1c8001-1751-4588-b15e-7f8c58ae9d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:11 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-dff7df0b-75aa-40f7-8cda-dd72a9639c60 tempest-VolumesGetTest-1337512028 None] Created volume successfully. Apr 09 16:57:11 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f 1073741824" returned: 0 in 0.503s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:11 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f Apr 09 16:57:11 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:12 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f" returned: 0 in 0.414s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.774s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2134922221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840b98ce-ed6b-4dd2-b143-a50f165ce7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ae67b433f54e9b8a359569af6f6d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:05Z,use_quota=True,user_id='c642365188b64e24b2a2117a1e493377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Creating volume 840b98ce-ed6b-4dd2-b143-a50f165ce7ca {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:12 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d95226-62ba-4fe6-9f99-4176fbb2def7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71069b65-67e8-4fa7-9566-941b6f770c3f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f31cff-cb94-4598-9da0-ea8d74e94690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:12 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca 1073741824 Apr 09 16:57:12 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Volume volume-71069b65-67e8-4fa7-9566-941b6f770c3f (71069b65-67e8-4fa7-9566-941b6f770c3f): created successfully Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f31cff-cb94-4598-9da0-ea8d74e94690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Flow 'volume_create_manager' (1a8ca445-f66e-4a44-8437-79aa0888314b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:12 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e86cb53a-5722-47dc-ad12-e01d645264da tempest-VolumesActionsTest-1383670629 None] Created volume successfully. Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (092c6884-18aa-4825-b185-a900ab1a3f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6484f339-827c-4271-b4cd-433d58e51e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6484f339-827c-4271-b4cd-433d58e51e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-309121659',display_name='tempest-VolumesGetTest-Volume-160244558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a4e7f3-2a5f-48c5-8cdf-877c73fa8946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:12Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12670c0-5c27-466d-9892-87a0565b45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12670c0-5c27-466d-9892-87a0565b45f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6752c75d-0cf5-4134-b3cd-82a7895061fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6752c75d-0cf5-4134-b3cd-82a7895061fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a4e7f3-2a5f-48c5-8cdf-877c73fa8946', 'volume_name': 'volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab070ee9-51b6-4d81-9e00-8982069e8a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab070ee9-51b6-4d81-9e00-8982069e8a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989cd959-1bff-453f-97ca-d9a3b1e0fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Volume 40a4e7f3-2a5f-48c5-8cdf-877c73fa8946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946', 'volume_size': 1} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:12 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca 1073741824" returned: 0 in 0.543s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:12 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca Apr 09 16:57:12 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:13 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca" returned: 0 in 0.424s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-309121659',display_name='tempest-VolumesGetTest-Volume-160244558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a4e7f3-2a5f-48c5-8cdf-877c73fa8946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:12Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Creating volume 40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:13 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822be6de-b7a4-4bfa-b255-4e91e141be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de49174-59c3-4fa3-befe-3df39f23c33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:13 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 1073741824 Apr 09 16:57:13 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:13 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Volume volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca (840b98ce-ed6b-4dd2-b143-a50f165ce7ca): created successfully Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de49174-59c3-4fa3-befe-3df39f23c33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Flow 'volume_create_manager' (a8ffe95f-e565-447a-82b0-f02f9231ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:13 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-425d2653-08e1-456b-9d1c-f62683dc06a4 tempest-VolumesTransfersV357Test-1431774785 None] Created volume successfully. Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Acquiring lock "cinder-71069b65-67e8-4fa7-9566-941b6f770c3f-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Lock "cinder-71069b65-67e8-4fa7-9566-941b6f770c3f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Acquiring lock "cinder-quobyte-71069b65-67e8-4fa7-9566-941b6f770c3f" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Lock "cinder-quobyte-71069b65-67e8-4fa7-9566-941b6f770c3f" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce12ee0-14d8-4905-b115-578d7e8e4843]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:13 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f Apr 09 16:57:13 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:13 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 1073741824" returned: 0 in 0.544s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:13 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 Apr 09 16:57:13 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:13 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f" returned: 0 in 0.484s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:13 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Acquiring lock "cinder-840b98ce-ed6b-4dd2-b143-a50f165ce7ca-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:13 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Lock "cinder-840b98ce-ed6b-4dd2-b143-a50f165ce7ca-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Acquiring lock "cinder-quobyte-840b98ce-ed6b-4dd2-b143-a50f165ce7ca" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Lock "cinder-quobyte-840b98ce-ed6b-4dd2-b143-a50f165ce7ca" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6fbef8-9d33-495d-8fc1-da1bbca485fb]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:14 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca Apr 09 16:57:14 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:14 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:14 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:14 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946" returned: 0 in 0.519s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989cd959-1bff-453f-97ca-d9a3b1e0fba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ddae05-3e36-41ae-b834-1ed408f1fc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:14 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Volume volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 (40a4e7f3-2a5f-48c5-8cdf-877c73fa8946): created successfully Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ddae05-3e36-41ae-b834-1ed408f1fc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (092c6884-18aa-4825-b185-a900ab1a3f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-22d79519-ad2c-4e91-8588-e1d81c1b9315 tempest-VolumesGetTest-1337512028 None] Created volume successfully. Apr 09 16:57:14 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71069b65-67e8-4fa7-9566-941b6f770c3f" returned: 0 in 0.460s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Lock "cinder-quobyte-71069b65-67e8-4fa7-9566-941b6f770c3f" released by "delete_volume" :: held 0.976s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Created reservations ['56ec927a-e615-4a16-96c7-ed12181d3e21', 'd5a2bf8c-14b2-4a2a-843b-4a1f6c2724df', '1996aee1-79ed-40f0-b3b2-430f4797fb4a', 'ca75edb2-0a31-46b5-af40-8ba87126b504'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:14 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:14 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:14 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.445s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:14 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca" returned: 0 in 0.602s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:14 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca Apr 09 16:57:14 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Lock "cinder-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a8dfb9-e42c-4ad6-9625-eecfbc132d4e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:14 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 Apr 09 16:57:14 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:14 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.464s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Deleted volume successfully. Apr 09 16:57:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-79e2458c-3083-483b-a929-96822c051b6d tempest-VolumesActionsTest-1383670629 None] Lock "cinder-71069b65-67e8-4fa7-9566-941b6f770c3f-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:15 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-840b98ce-ed6b-4dd2-b143-a50f165ce7ca" returned: 0 in 0.510s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Lock "cinder-quobyte-840b98ce-ed6b-4dd2-b143-a50f165ce7ca" released by "delete_volume" :: held 1.131s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Created reservations ['7802e7db-d498-4756-b422-8c18530fb452', '25b4548f-4d59-4cf4-8718-9d8f094b7225', 'ea2dcbf5-3e66-4f4e-89f3-3f767c1201ad', '60cd4d7a-9d26-436e-8dc2-4c7646d003d6'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:15 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:15 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:15 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946" returned: 0 in 0.531s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:15 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946 Apr 09 16:57:15 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:15 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.436s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:15 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Deleted volume successfully. Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-60036a5b-7154-41d5-ac95-8cab182b7933 tempest-VolumesTransfersV357Test-434806550 None] Lock "cinder-840b98ce-ed6b-4dd2-b143-a50f165ce7ca-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:15 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946" returned: 0 in 0.459s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946" released by "delete_volume" :: held 1.009s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Created reservations ['444bf568-3353-4f1d-bb9f-9406ef35b180', 'af446416-bed3-4c14-b95d-534ba5f135f2', '04af211d-eb3e-4f3b-95f6-6998f49fdc87', '2d61cea8-612e-4581-8e2f-e3db38503262'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:15 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:15 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:16 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.444s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:16 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Deleted volume successfully. Apr 09 16:57:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c64f6fbd-d30b-40e6-a7af-d0b6230b8c70 tempest-VolumesGetTest-1337512028 None] Lock "cinder-40a4e7f3-2a5f-48c5-8cdf-877c73fa8946-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-0fcfa8ad-21f1-459e-b512-0988fff2e2fd-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Lock "cinder-0fcfa8ad-21f1-459e-b512-0988fff2e2fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5d314-d833-4bb8-bb40-d4d04e74cfd5]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:17 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd Apr 09 16:57:17 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:17 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" returned: 0 in 0.526s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:17 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd Apr 09 16:57:17 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:18 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" returned: 0 in 0.529s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-0fcfa8ad-21f1-459e-b512-0988fff2e2fd" released by "delete_volume" :: held 1.081s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=206,cinder:SELECT=156,cinder:INSERT=55,cinder:DELETE=16 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Created reservations ['f6b9a9b3-0a28-448a-99a5-b755b5ab8f96', '51d21b14-ad95-4a5f-9613-76bb9cb713f5', 'd86ad930-55fa-4a99-8b36-685adc9a26a4', '618bfe87-3f85-439d-9ce9-3e3f5b48ac7a'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:18 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:18 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:18 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.535s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:18 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Deleted volume successfully. Apr 09 16:57:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8b71d64c-9939-493b-b8d6-faa82234f497 tempest-VolumesGetTest-1337512028 None] Lock "cinder-0fcfa8ad-21f1-459e-b512-0988fff2e2fd-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-71b60238-23f7-4c84-8737-cc45bf58a3a3-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Lock "cinder-71b60238-23f7-4c84-8737-cc45bf58a3a3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-71b60238-23f7-4c84-8737-cc45bf58a3a3" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-71b60238-23f7-4c84-8737-cc45bf58a3a3" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eef2ee-95a7-4393-9702-5d86c3c63ef1]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:19 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 Apr 09 16:57:19 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=152,cinder:INSERT=50,cinder:UPDATE=239,cinder:DELETE=23 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Flow 'volume_create_manager' (d5a9ffe6-af91-4890-bff2-8082e2101f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c759bf9-e0dc-443f-9fbf-a01c94e28a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c759bf9-e0dc-443f-9fbf-a01c94e28a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1754936474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911790e0-e1e5-400d-bdc8-a20a087fabbd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='104802ed108c4664afc2b26a2213cd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:20Z,use_quota=True,user_id='f4b78f36683f4d1c90fc07c3f8c5db86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6aa16f-f0b4-4e8c-b7af-78eb7e3909c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6aa16f-f0b4-4e8c-b7af-78eb7e3909c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec57f9d-e7ea-46e1-98d4-ad929c620904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec57f9d-e7ea-46e1-98d4-ad929c620904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911790e0-e1e5-400d-bdc8-a20a087fabbd', 'volume_name': 'volume-911790e0-e1e5-400d-bdc8-a20a087fabbd', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01653c6b-7f8b-480b-b01e-db08aaaccefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01653c6b-7f8b-480b-b01e-db08aaaccefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed59508-b4f1-49ea-a806-5da5c6e4a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:19 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Volume 911790e0-e1e5-400d-bdc8-a20a087fabbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911790e0-e1e5-400d-bdc8-a20a087fabbd', 'volume_size': 1} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1754936474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911790e0-e1e5-400d-bdc8-a20a087fabbd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='104802ed108c4664afc2b26a2213cd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:20Z,use_quota=True,user_id='f4b78f36683f4d1c90fc07c3f8c5db86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Creating volume 911790e0-e1e5-400d-bdc8-a20a087fabbd {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:19 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:19 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3" returned: 0 in 0.529s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:19 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd 1073741824 Apr 09 16:57:19 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:19 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3 Apr 09 16:57:19 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:20 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-71b60238-23f7-4c84-8737-cc45bf58a3a3" returned: 0 in 0.529s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-71b60238-23f7-4c84-8737-cc45bf58a3a3" released by "delete_volume" :: held 1.094s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Created reservations ['0388c5a2-1991-4dcd-a057-c1c67cdaf6e0', 'e90d9a2e-61a1-405c-a18d-febf6b298da2', '5ea7aa3e-a2bf-4e12-90f5-002f3f9455a6', 'e192f644-dd0e-4868-ad31-5625735dca92'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:20 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd 1073741824" returned: 0 in 0.654s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:20 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd Apr 09 16:57:20 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:20 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:20 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:20 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd" returned: 0 in 0.503s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed59508-b4f1-49ea-a806-5da5c6e4a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911790e0-e1e5-400d-bdc8-a20a087fabbd', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d51c23f-114d-42ae-84f2-494f36509c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:21 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Volume volume-911790e0-e1e5-400d-bdc8-a20a087fabbd (911790e0-e1e5-400d-bdc8-a20a087fabbd): created successfully Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d51c23f-114d-42ae-84f2-494f36509c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Flow 'volume_create_manager' (d5a9ffe6-af91-4890-bff2-8082e2101f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:21 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-97d0d7a0-518e-49fd-953e-0f2d35a3c0ce tempest-VolumesListTestJSON-902466282 None] Created volume successfully. Apr 09 16:57:21 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.524s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:21 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Deleted volume successfully. Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-476c0748-5e0a-462e-9265-e6d1180a3aa9 tempest-VolumesGetTest-1337512028 None] Lock "cinder-71b60238-23f7-4c84-8737-cc45bf58a3a3-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (0c8737b5-90f3-455c-b036-35c0e802c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac11272-053c-4651-b9fd-bef0a76dfccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac11272-053c-4651-b9fd-bef0a76dfccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-299055978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:22Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43359266-e54a-4bbf-b018-921926aadedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43359266-e54a-4bbf-b018-921926aadedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34a4046-c184-452e-8273-e112e4314b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:21 devstack cinder-volume[82139]: DEBUG cinder.image.glance [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Creating Keystone auth plugin from conf {{(pid=82139) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Flow 'volume_create_manager' (74f81e1e-dc78-4f62-a387-5933005bea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65c771a-8fe1-4318-a35a-9db04105d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65c771a-8fe1-4318-a35a-9db04105d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2115734794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4119e397-f548-44a0-9422-8b4b887d4fac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='104802ed108c4664afc2b26a2213cd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:22Z,use_quota=True,user_id='f4b78f36683f4d1c90fc07c3f8c5db86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1d8f51-277c-4900-97b1-aa062a05ddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1d8f51-277c-4900-97b1-aa062a05ddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2faa5e-79c5-4b3a-924d-9b05dc0ee535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2faa5e-79c5-4b3a-924d-9b05dc0ee535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4119e397-f548-44a0-9422-8b4b887d4fac', 'volume_name': 'volume-4119e397-f548-44a0-9422-8b4b887d4fac', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce763d0-4ba0-4b25-93de-8712241e535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce763d0-4ba0-4b25-93de-8712241e535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef029e2a-0411-4d1d-8316-cf02ba092613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:22 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Volume 4119e397-f548-44a0-9422-8b4b887d4fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4119e397-f548-44a0-9422-8b4b887d4fac', 'volume_size': 1} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2115734794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4119e397-f548-44a0-9422-8b4b887d4fac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='104802ed108c4664afc2b26a2213cd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:22Z,use_quota=True,user_id='f4b78f36683f4d1c90fc07c3f8c5db86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Creating volume 4119e397-f548-44a0-9422-8b4b887d4fac {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:22 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:22 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac 1073741824 Apr 09 16:57:22 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34a4046-c184-452e-8273-e112e4314b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb', 'volume_name': 'volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68cdd4b-ca06-4168-b69a-51cdb198502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68cdd4b-ca06-4168-b69a-51cdb198502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063a176c-aeca-40ab-aef1-6327acfe916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:22 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Volume a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Trying to clone a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb from image d01216e8-c5dc-4c96-8184-f8935064d568 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]). {{(pid=82139) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 16:57:22 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Image download 20.69 MB at 20.69 MB/s Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33566f-87cc-44f0-bc06-977c1b913621]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:22 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD Apr 09 16:57:22 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:22 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac 1073741824" returned: 0 in 0.611s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:22 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac Apr 09 16:57:22 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:22 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:22 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Temporary image d01216e8-c5dc-4c96-8184-f8935064d568 is fetched for user cac2faaafd5946bda41d3f387bdac216. {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8874bb3b-8603-4399-9c1e-046b501493da]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Flow 'volume_create_manager' (27471c2f-0b0b-4071-82aa-6fa0581b880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abd110f-be7f-470c-bbce-20f40e0beadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:23 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD Apr 09 16:57:23 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abd110f-be7f-470c-bbce-20f40e0beadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1987571203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998b2e17-6a6a-4f5e-9dd1-9371e1667e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9812cf73b095490b81e5b39d43873d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:23Z,use_quota=True,user_id='8d0a13521a4b4946a64442573e34ee5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b55b73-32d3-47c6-a5f1-f31bedc59f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b55b73-32d3-47c6-a5f1-f31bedc59f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed7ab92-2179-41b6-a039-359a09fe5205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed7ab92-2179-41b6-a039-359a09fe5205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998b2e17-6a6a-4f5e-9dd1-9371e1667e31', 'volume_name': 'volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa35944b-8586-4fc8-a0a5-3dcd142a8e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa35944b-8586-4fc8-a0a5-3dcd142a8e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da48748-a376-4556-823e-4ea08df66085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:23 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Volume 998b2e17-6a6a-4f5e-9dd1-9371e1667e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31', 'volume_size': 1} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:23 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.156s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1987571203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998b2e17-6a6a-4f5e-9dd1-9371e1667e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9812cf73b095490b81e5b39d43873d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:23Z,use_quota=True,user_id='8d0a13521a4b4946a64442573e34ee5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Creating volume 998b2e17-6a6a-4f5e-9dd1-9371e1667e31 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:23 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef029e2a-0411-4d1d-8316-cf02ba092613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4119e397-f548-44a0-9422-8b4b887d4fac', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efdec55-75ce-48cf-9d78-c9223276b0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:23 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 1073741824 Apr 09 16:57:23 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:23 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Volume volume-4119e397-f548-44a0-9422-8b4b887d4fac (4119e397-f548-44a0-9422-8b4b887d4fac): created successfully Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efdec55-75ce-48cf-9d78-c9223276b0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Flow 'volume_create_manager' (74f81e1e-dc78-4f62-a387-5933005bea01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:23 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a6d7e003-4dc9-433b-849e-0bacdef88579 tempest-VolumesListTestJSON-902466282 None] Created volume successfully. Apr 09 16:57:23 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:23 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 1073741824" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:23 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 Apr 09 16:57:23 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:24 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31" returned: 0 in 0.426s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-299055978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:22Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Creating volume a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:24 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da48748-a376-4556-823e-4ea08df66085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de45373a-5195-4669-8c7f-1751ab2e7b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:24 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb 1073741824 Apr 09 16:57:24 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:24 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Volume volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 (998b2e17-6a6a-4f5e-9dd1-9371e1667e31): created successfully Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de45373a-5195-4669-8c7f-1751ab2e7b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Flow 'volume_create_manager' (27471c2f-0b0b-4071-82aa-6fa0581b880f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:24 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3f917a52-0cf0-4199-a1aa-f4cfb27cec96 tempest-VolumesListAdminTestJSON-1950383105 None] Created volume successfully. Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Flow 'volume_create_manager' (9b850dc0-81ab-4831-be87-e909698436e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71759588-14fb-4f57-9460-e29f542c480a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71759588-14fb-4f57-9460-e29f542c480a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1733472257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4d1a66-a361-4204-ba83-87368da6db82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='104802ed108c4664afc2b26a2213cd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:24Z,use_quota=True,user_id='f4b78f36683f4d1c90fc07c3f8c5db86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5714290-bb66-4230-86d6-68d741c7f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5714290-bb66-4230-86d6-68d741c7f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49b596f-7e27-4a8c-a590-f7b190e06d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49b596f-7e27-4a8c-a590-f7b190e06d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4d1a66-a361-4204-ba83-87368da6db82', 'volume_name': 'volume-ad4d1a66-a361-4204-ba83-87368da6db82', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9aa123-b337-44eb-b5da-06da35c27e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9aa123-b337-44eb-b5da-06da35c27e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89bf465-3aa4-4dec-8da1-ae9a89a89ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:24 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Volume ad4d1a66-a361-4204-ba83-87368da6db82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4d1a66-a361-4204-ba83-87368da6db82', 'volume_size': 1} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:24 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb 1073741824" returned: 0 in 0.504s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:24 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb Apr 09 16:57:24 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:25 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" returned: 0 in 0.415s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1733472257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4d1a66-a361-4204-ba83-87368da6db82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='104802ed108c4664afc2b26a2213cd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:24Z,use_quota=True,user_id='f4b78f36683f4d1c90fc07c3f8c5db86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Creating volume ad4d1a66-a361-4204-ba83-87368da6db82 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:25 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Attempting download of d01216e8-c5dc-4c96-8184-f8935064d568 ((None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}])) to volume a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb. {{(pid=82139) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 16:57:25 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 1073741824 Apr 09 16:57:25 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ed83f-449d-459d-af04-c9e26d7a698e]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_8k7aajzn {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:25 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_8k7aajzn Apr 09 16:57:25 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Flow 'volume_create_manager' (b741a68f-1401-448f-af77-4aa6658e1bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7fafe6-d75c-4250-8f37-9f3108481b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7fafe6-d75c-4250-8f37-9f3108481b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1932515264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef150f1-3fd1-4d03-98ec-c58c729aba32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9812cf73b095490b81e5b39d43873d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:25Z,use_quota=True,user_id='8d0a13521a4b4946a64442573e34ee5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fd57cc-902b-4c3b-b640-c6f61876a3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fd57cc-902b-4c3b-b640-c6f61876a3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d15b17-acb7-4f1c-9117-1ffd505e56fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d15b17-acb7-4f1c-9117-1ffd505e56fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef150f1-3fd1-4d03-98ec-c58c729aba32', 'volume_name': 'volume-aef150f1-3fd1-4d03-98ec-c58c729aba32', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670f436d-bd1a-4bf9-a977-3cf9ca5875c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670f436d-bd1a-4bf9-a977-3cf9ca5875c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d84360-0843-4a09-8750-e17d8b61a38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Volume aef150f1-3fd1-4d03-98ec-c58c729aba32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef150f1-3fd1-4d03-98ec-c58c729aba32', 'volume_size': 1} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:25 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 1073741824" returned: 0 in 0.505s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:25 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_8k7aajzn" returned: 0 in 0.479s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_8k7aajzn {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:25 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 Apr 09 16:57:25 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:25 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_8k7aajzn Apr 09 16:57:25 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:26 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82" returned: 0 in 0.430s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1932515264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef150f1-3fd1-4d03-98ec-c58c729aba32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9812cf73b095490b81e5b39d43873d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:25Z,use_quota=True,user_id='8d0a13521a4b4946a64442573e34ee5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Creating volume aef150f1-3fd1-4d03-98ec-c58c729aba32 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:26 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89bf465-3aa4-4dec-8da1-ae9a89a89ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4d1a66-a361-4204-ba83-87368da6db82', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd30fb37-2c6f-4786-9b97-021011cf574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:26 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 1073741824 Apr 09 16:57:26 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:26 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Volume volume-ad4d1a66-a361-4204-ba83-87368da6db82 (ad4d1a66-a361-4204-ba83-87368da6db82): created successfully Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd30fb37-2c6f-4786-9b97-021011cf574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Flow 'volume_create_manager' (9b850dc0-81ab-4831-be87-e909698436e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:26 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8688e429-2a9c-4cb6-b6dd-aac4100daa3c tempest-VolumesListTestJSON-902466282 None] Created volume successfully. Apr 09 16:57:26 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_8k7aajzn" returned: 1 in 0.491s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_8k7aajzn' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b4723-256f-4450-97fb-2b9e28d57434]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:26 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD Apr 09 16:57:26 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:26 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 1073741824" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:26 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 Apr 09 16:57:26 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:26 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD" returned: 0 in 0.507s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] d01216e8-c5dc-4c96-8184-f8935064d568 was qcow2, converting to raw {{(pid=82139) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 16:57:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:26 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb Apr 09 16:57:26 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:27 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32" returned: 0 in 0.514s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d84360-0843-4a09-8750-e17d8b61a38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef150f1-3fd1-4d03-98ec-c58c729aba32', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4e0afa-103d-499d-890e-42f7359276f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:27 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Volume volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 (aef150f1-3fd1-4d03-98ec-c58c729aba32): created successfully Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4e0afa-103d-499d-890e-42f7359276f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Flow 'volume_create_manager' (b741a68f-1401-448f-af77-4aa6658e1bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-aa8e3ed9-4ec3-4d97-8038-6201fc86e7e1 tempest-VolumesListAdminTestJSON-1950383105 None] Created volume successfully. Apr 09 16:57:27 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" returned: 0 in 0.969s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568_be642nf5devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:57:27 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Converted 112.00 MB image at 112.00 MB/s Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:27 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb 1G Apr 09 16:57:27 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Flow 'volume_create_manager' (7fb2631c-c514-41ee-88af-bd05d0a2d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361a827e-c067-489a-9503-98090ba807d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361a827e-c067-489a-9503-98090ba807d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-217802790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302256a8-84ba-485d-8f40-0664925ec1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9812cf73b095490b81e5b39d43873d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:28Z,use_quota=True,user_id='8d0a13521a4b4946a64442573e34ee5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6157853-1a13-4cff-b634-50959a5a2a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6157853-1a13-4cff-b634-50959a5a2a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e85035-ad38-4279-a326-192281c9c749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e85035-ad38-4279-a326-192281c9c749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302256a8-84ba-485d-8f40-0664925ec1fe', 'volume_name': 'volume-302256a8-84ba-485d-8f40-0664925ec1fe', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a38842e-0ab7-421f-88de-5b20eec131cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a38842e-0ab7-421f-88de-5b20eec131cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0d8efb-b17f-4c71-b926-11979fee4c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:27 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Volume 302256a8-84ba-485d-8f40-0664925ec1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302256a8-84ba-485d-8f40-0664925ec1fe', 'volume_size': 1} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-217802790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302256a8-84ba-485d-8f40-0664925ec1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9812cf73b095490b81e5b39d43873d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:28Z,use_quota=True,user_id='8d0a13521a4b4946a64442573e34ee5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Creating volume 302256a8-84ba-485d-8f40-0664925ec1fe {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:27 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:27 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe 1073741824 Apr 09 16:57:27 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:28 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb 1G" returned: 0 in 0.504s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8972dc2-52ce-4594-a123-fc58efb24c9f]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:28 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb Apr 09 16:57:28 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:28 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe 1073741824" returned: 0 in 0.514s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:28 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe Apr 09 16:57:28 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Acquiring lock "cinder-ad4d1a66-a361-4204-ba83-87368da6db82-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Lock "cinder-ad4d1a66-a361-4204-ba83-87368da6db82-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Acquiring lock "cinder-quobyte-ad4d1a66-a361-4204-ba83-87368da6db82" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Lock "cinder-quobyte-ad4d1a66-a361-4204-ba83-87368da6db82" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:28 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[41956ef7-ff16-48d4-bc03-1d4e882578a1]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" returned: 0 in 0.576s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:28 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 Apr 09 16:57:28 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:28 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb Apr 09 16:57:28 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:28 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe" returned: 0 in 0.456s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0d8efb-b17f-4c71-b926-11979fee4c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302256a8-84ba-485d-8f40-0664925ec1fe', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a844b13-bfcf-424b-aae0-72d5ca6608b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:28 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Volume volume-302256a8-84ba-485d-8f40-0664925ec1fe (302256a8-84ba-485d-8f40-0664925ec1fe): created successfully Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a844b13-bfcf-424b-aae0-72d5ca6608b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Flow 'volume_create_manager' (7fb2631c-c514-41ee-88af-bd05d0a2d009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2cb24434-53d8-4d6f-83bb-a461bdcdc0a4 tempest-VolumesListAdminTestJSON-1950383105 None] Created volume successfully. Apr 09 16:57:29 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" returned: 1 in 0.499s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Downloaded image d01216e8-c5dc-4c96-8184-f8935064d568 ((None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}])) to volume a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb successfully. {{(pid=82139) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 16:57:29 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Temporary image d01216e8-c5dc-4c96-8184-f8935064d568 for user cac2faaafd5946bda41d3f387bdac216 is deleted. {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Marking volume a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb as bootable. {{(pid=82139) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82" returned: 0 in 0.522s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Copying metadata from image d01216e8-c5dc-4c96-8184-f8935064d568 to a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb. {{(pid=82139) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Creating volume glance metadata for volume a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb backed by image d01216e8-c5dc-4c96-8184-f8935064d568 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82139) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 16:57:29 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82 Apr 09 16:57:29 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063a176c-aeca-40ab-aef1-6327acfe916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d0b3cf-70b1-4f16-aa23-78c5b8411eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:29 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Volume volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb (a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb): created successfully Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d0b3cf-70b1-4f16-aa23-78c5b8411eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (0c8737b5-90f3-455c-b036-35c0e802c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c9159623-c7f6-417e-ba7b-85966a0e4173 tempest-VolumesGetTest-1337512028 None] Created volume successfully. Apr 09 16:57:29 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ad4d1a66-a361-4204-ba83-87368da6db82" returned: 0 in 0.418s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Lock "cinder-quobyte-ad4d1a66-a361-4204-ba83-87368da6db82" released by "delete_volume" :: held 0.969s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Created reservations ['67ca6d9d-b62c-4cf7-8eb1-a629d00fbc2f', '77f23f0b-3747-49e5-b29d-a5d4a2a8ea09', '9127b1f5-22e5-47cd-92b7-e9059cbbc892', 'c764afc8-46e9-418f-82df-b73742318239'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:29 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:29 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Acquiring lock "cinder-4119e397-f548-44a0-9422-8b4b887d4fac-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Lock "cinder-4119e397-f548-44a0-9422-8b4b887d4fac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Acquiring lock "cinder-quobyte-4119e397-f548-44a0-9422-8b4b887d4fac" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Lock "cinder-quobyte-4119e397-f548-44a0-9422-8b4b887d4fac" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[53def50a-398e-466e-b700-ddafe9037639]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:30 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac Apr 09 16:57:30 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:30 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.481s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Deleted volume successfully. Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d9413ae-9510-41c2-a4e1-63365c7f80b2 tempest-VolumesListTestJSON-902466282 None] Lock "cinder-ad4d1a66-a361-4204-ba83-87368da6db82-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Flow 'volume_create_manager' (8df3d8d4-d704-4871-9a45-27421f521a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2754e549-f2d2-4e24-905a-58da2617c8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2754e549-f2d2-4e24-905a-58da2617c8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de78df30-833c-4aee-9218-4119be1e35d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bbb3948883b44c695afc7b1d59d02d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:30Z,use_quota=True,user_id='2d90be8956294915902b60005a5d02b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6983a60c-9bb6-414a-8861-3862e96dfa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6983a60c-9bb6-414a-8861-3862e96dfa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38dcdbe6-2655-4dfd-84a2-996b32b25ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38dcdbe6-2655-4dfd-84a2-996b32b25ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de78df30-833c-4aee-9218-4119be1e35d3', 'volume_name': 'volume-de78df30-833c-4aee-9218-4119be1e35d3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc3a66c-4b45-48b7-a3b1-b3522d93c1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc3a66c-4b45-48b7-a3b1-b3522d93c1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff5522b-8071-414a-918f-ce9af701f5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Volume de78df30-833c-4aee-9218-4119be1e35d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de78df30-833c-4aee-9218-4119be1e35d3', 'volume_size': 1} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de78df30-833c-4aee-9218-4119be1e35d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bbb3948883b44c695afc7b1d59d02d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:30Z,use_quota=True,user_id='2d90be8956294915902b60005a5d02b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Creating volume de78df30-833c-4aee-9218-4119be1e35d3 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:30 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:30 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 1073741824 Apr 09 16:57:30 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:30 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac" returned: 0 in 0.560s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:30 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac Apr 09 16:57:30 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (b5c0bc6b-ba58-4fbf-8ef5-da7b9c4fc8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193a1ea4-0dee-4ed4-86cd-146f6a4de01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193a1ea4-0dee-4ed4-86cd-146f6a4de01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-11698243',display_name='tempest-VolumesGetTest-Volume-1773749328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:31Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2f8821-1c66-434c-9cea-683d5e516ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2f8821-1c66-434c-9cea-683d5e516ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcd8e67-1d45-4772-8b66-3b83f829a006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcd8e67-1d45-4772-8b66-3b83f829a006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8', 'volume_name': 'volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591e3b41-bb49-4c8a-bd8d-626c5ed2ea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591e3b41-bb49-4c8a-bd8d-626c5ed2ea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf731c1-253e-4955-90ee-52716bfe52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:30 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Volume 3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8', 'volume_size': 1} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:30 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 1073741824" returned: 0 in 0.502s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:31 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 Apr 09 16:57:31 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:31 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4119e397-f548-44a0-9422-8b4b887d4fac" returned: 0 in 0.489s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Lock "cinder-quobyte-4119e397-f548-44a0-9422-8b4b887d4fac" released by "delete_volume" :: held 1.078s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Created reservations ['886024d4-127f-4a61-bb49-73242ec4975e', '9cfbb7c2-6947-4324-8234-2d7f6ac50a32', '36d9e458-7ef5-4459-b58f-b3ab4f166635', '47ec7995-ed20-457a-a7a1-4ceafe898c4c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:31 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:31 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:31 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3" returned: 0 in 0.435s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-11698243',display_name='tempest-VolumesGetTest-Volume-1773749328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e13ce21d2a4839bf523f998b421d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:31Z,use_quota=True,user_id='cac2faaafd5946bda41d3f387bdac216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Creating volume 3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:31 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff5522b-8071-414a-918f-ce9af701f5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de78df30-833c-4aee-9218-4119be1e35d3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:31 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 1073741824 Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f603b0bf-4636-4213-9d7c-6cca3a930949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:31 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:31 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Volume volume-de78df30-833c-4aee-9218-4119be1e35d3 (de78df30-833c-4aee-9218-4119be1e35d3): created successfully Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f603b0bf-4636-4213-9d7c-6cca3a930949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Flow 'volume_create_manager' (8df3d8d4-d704-4871-9a45-27421f521a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:31 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-77eabb91-5ded-4abc-aced-8467cfa0a0fb tempest-VolumesListAdminTestJSON-137338286 None] Created volume successfully. Apr 09 16:57:31 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.435s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:31 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Deleted volume successfully. Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7c916083-8f6d-4c16-87bb-034911f50b74 tempest-VolumesListTestJSON-902466282 None] Lock "cinder-4119e397-f548-44a0-9422-8b4b887d4fac-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:31 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 1073741824" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:31 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 Apr 09 16:57:31 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Acquiring lock "cinder-911790e0-e1e5-400d-bdc8-a20a087fabbd-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Lock "cinder-911790e0-e1e5-400d-bdc8-a20a087fabbd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Acquiring lock "cinder-quobyte-911790e0-e1e5-400d-bdc8-a20a087fabbd" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Lock "cinder-quobyte-911790e0-e1e5-400d-bdc8-a20a087fabbd" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eeeced-d46e-4362-9e03-1d0d4141cda9]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:32 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd Apr 09 16:57:32 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:32 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8" returned: 0 in 0.435s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf731c1-253e-4955-90ee-52716bfe52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c585c1-8996-4a57-b727-1d58bd4b0ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:32 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Volume volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 (3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8): created successfully Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c585c1-8996-4a57-b727-1d58bd4b0ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Flow 'volume_create_manager' (b5c0bc6b-ba58-4fbf-8ef5-da7b9c4fc8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:32 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1ad8d37e-dd97-4cb6-9190-db713966ee32 tempest-VolumesGetTest-1337512028 None] Created volume successfully. Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Acquiring lock "cinder-de78df30-833c-4aee-9218-4119be1e35d3-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Lock "cinder-de78df30-833c-4aee-9218-4119be1e35d3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Acquiring lock "cinder-quobyte-de78df30-833c-4aee-9218-4119be1e35d3" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Lock "cinder-quobyte-de78df30-833c-4aee-9218-4119be1e35d3" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7191e253-669f-4be2-8433-4c0ba35e3077]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "cinder-302256a8-84ba-485d-8f40-0664925ec1fe-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:32 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 Apr 09 16:57:32 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-302256a8-84ba-485d-8f40-0664925ec1fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "cinder-quobyte-302256a8-84ba-485d-8f40-0664925ec1fe" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-quobyte-302256a8-84ba-485d-8f40-0664925ec1fe" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2430a7d-a4ec-4d92-bc15-3b79428aaddf]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:32 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd" returned: 0 in 0.525s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:32 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd Apr 09 16:57:32 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:32 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe Apr 09 16:57:32 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Lock "cinder-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7cfda7-73c8-4576-99da-9315940a0270]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:33 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 Apr 09 16:57:33 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:33 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3" returned: 0 in 0.528s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:33 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3 Apr 09 16:57:33 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:33 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:33 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-911790e0-e1e5-400d-bdc8-a20a087fabbd" returned: 0 in 0.517s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Lock "cinder-quobyte-911790e0-e1e5-400d-bdc8-a20a087fabbd" released by "delete_volume" :: held 1.064s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:33 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe Apr 09 16:57:33 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Created reservations ['55583032-3daf-463d-bf7f-4854b9f9a4d4', '274d4975-aa4e-4b81-ae1b-07b04e5474ee', '9b7d3e19-0131-48ea-98a6-af42ac5603e9', '07146ecd-9d98-4db8-8a2f-3c7495aa060e'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:33 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:33 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:33 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8" returned: 0 in 0.521s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:33 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8 Apr 09 16:57:33 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:33 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-de78df30-833c-4aee-9218-4119be1e35d3" returned: 0 in 0.477s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Lock "cinder-quobyte-de78df30-833c-4aee-9218-4119be1e35d3" released by "delete_volume" :: held 1.041s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Created reservations ['ab33074f-fb36-44d3-a436-f5c49d36bbb5', 'f2f969c7-cc5f-4fdd-990b-209f6cdb9418', 'af73c561-b182-4a93-b4a3-c3ff42df299b', 'c9358ede-1ce0-41bc-a47e-6afe3b699149'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:33 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:33 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:33 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-302256a8-84ba-485d-8f40-0664925ec1fe" returned: 0 in 0.508s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-quobyte-302256a8-84ba-485d-8f40-0664925ec1fe" released by "delete_volume" :: held 1.058s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Created reservations ['2571974c-6854-49e8-8ec3-19cd863d4326', 'cd0bb652-4254-44ab-90e6-b319fa20e1d1', '97972307-ff49-4985-913a-6416f136e1c4', '3f531e0c-5c13-40f0-bcd9-f91581c5a977'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:33 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.474s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Deleted volume successfully. Apr 09 16:57:33 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:33 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-28f0a99c-415f-4cb6-af64-e259525ce7cf tempest-VolumesListTestJSON-902466282 None] Lock "cinder-911790e0-e1e5-400d-bdc8-a20a087fabbd-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:33 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8" returned: 0 in 0.438s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8" released by "delete_volume" :: held 0.992s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:33 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Created reservations ['e0bf8232-d7f7-4b94-8550-611697aa4ca2', '07cd896d-8842-41d0-acc7-b2d80f2aac29', 'fb411a17-4779-48a6-81db-7f5eca0e2429', 'b6b5bf89-dfc1-4e2d-8322-613237803e16'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:34 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:34 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:34 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:34 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Deleted volume successfully. Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d1331b-44a9-4565-bc20-72afca677a0f tempest-VolumesListAdminTestJSON-137338286 None] Lock "cinder-de78df30-833c-4aee-9218-4119be1e35d3-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:34 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:34 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Deleted volume successfully. Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e8bd3c45-5ddf-401f-a42b-5ce188b0159b tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-302256a8-84ba-485d-8f40-0664925ec1fe-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:34 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.426s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:34 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Deleted volume successfully. Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f7534399-e332-43c1-bb95-d5d762c5ea5e tempest-VolumesGetTest-1337512028 None] Lock "cinder-3c4aba7e-d9a8-4d7b-96c4-e7f1660191e8-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "cinder-aef150f1-3fd1-4d03-98ec-c58c729aba32-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-aef150f1-3fd1-4d03-98ec-c58c729aba32-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "cinder-quobyte-aef150f1-3fd1-4d03-98ec-c58c729aba32" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-quobyte-aef150f1-3fd1-4d03-98ec-c58c729aba32" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddad44bc-58d4-487e-98d8-0180b8c8ed2a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:35 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 Apr 09 16:57:35 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Lock "cinder-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Acquiring lock "cinder-quobyte-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" acquired by "delete_volume" :: waited 0.020s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7c1aee-8c1b-45a0-8ff7-79b8aa27a140]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:35 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb Apr 09 16:57:35 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:35 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32" returned: 0 in 0.549s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:35 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32 Apr 09 16:57:35 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:35 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:35 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb Apr 09 16:57:35 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:35 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aef150f1-3fd1-4d03-98ec-c58c729aba32" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-quobyte-aef150f1-3fd1-4d03-98ec-c58c729aba32" released by "delete_volume" :: held 1.056s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:35 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Created reservations ['042ae83f-81e1-4dcc-b0ec-d5b876645be1', '4cd57252-7f68-467d-af11-8e1f84b3ea73', 'c07229dc-8a11-4534-9ce8-7737f061962a', '4d14fd46-ef97-4305-8d37-65f8fd8342d3'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:36 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:36 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Flow 'volume_create_manager' (82dbe488-e414-40a6-8b9a-a8be7be394f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd05d84-9731-4010-a9f9-b60ca2c1059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd05d84-9731-4010-a9f9-b60ca2c1059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46325ba-5ae0-4929-8b70-6b1636a55bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea491c2b485473e945c4c7ac4918907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:36Z,use_quota=True,user_id='2ad65baf2bab488ba5a405accf4e7460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3748f163-7340-4e31-a84b-c69551d58c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3748f163-7340-4e31-a84b-c69551d58c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a5e6af-a14a-4ddf-bdb9-65d169b1aaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a5e6af-a14a-4ddf-bdb9-65d169b1aaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46325ba-5ae0-4929-8b70-6b1636a55bf3', 'volume_name': 'volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37cdaad-4386-4dec-87a6-98050aae4e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37cdaad-4386-4dec-87a6-98050aae4e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca08571-f953-4b8a-a566-12b340f73ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:36 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Volume b46325ba-5ae0-4929-8b70-6b1636a55bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3', 'volume_size': 1} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46325ba-5ae0-4929-8b70-6b1636a55bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea491c2b485473e945c4c7ac4918907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:36Z,use_quota=True,user_id='2ad65baf2bab488ba5a405accf4e7460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Creating volume b46325ba-5ae0-4929-8b70-6b1636a55bf3 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:36 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:36 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 1073741824 Apr 09 16:57:36 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:36 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" returned: 1 in 0.554s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:36 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb Apr 09 16:57:36 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:36 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.429s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Deleted volume successfully. Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4ae3291b-a3bd-430b-8da8-9b7ef0233ed8 tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-aef150f1-3fd1-4d03-98ec-c58c729aba32-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:36 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 1073741824" returned: 0 in 0.497s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:36 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 Apr 09 16:57:36 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:36 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" returned: 0 in 0.436s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Lock "cinder-quobyte-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb" released by "delete_volume" :: held 1.559s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Created reservations ['9aec5c9e-9635-4a66-ba61-dfd31b5a9604', '67c9bfba-7ff1-4399-ad17-6e360f42e06b', '1b715f95-169f-49d8-ba85-b70f36a7e908', 'c543ad3a-e4a4-4882-9369-00e0b350a38c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:36 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:36 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "cinder-998b2e17-6a6a-4f5e-9dd1-9371e1667e31-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-998b2e17-6a6a-4f5e-9dd1-9371e1667e31-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "cinder-quobyte-998b2e17-6a6a-4f5e-9dd1-9371e1667e31" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-quobyte-998b2e17-6a6a-4f5e-9dd1-9371e1667e31" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabdb781-b5ab-435d-95a5-64bf5494dd5d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:37 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3" returned: 0 in 0.487s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca08571-f953-4b8a-a566-12b340f73ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea711250-6cc8-43d4-9b94-325d93f84a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:37 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Volume volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 (b46325ba-5ae0-4929-8b70-6b1636a55bf3): created successfully Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea711250-6cc8-43d4-9b94-325d93f84a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Flow 'volume_create_manager' (82dbe488-e414-40a6-8b9a-a8be7be394f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:37 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ed3d0dbf-78bd-4ec6-aa8e-8531507f8ddc tempest-CinderUnicodeTest-1828986794 None] Created volume successfully. Apr 09 16:57:37 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 Apr 09 16:57:37 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:37 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.462s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:37 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Deleted volume successfully. Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ba1fd3c6-0e2d-4161-80ef-0acd8ddb49f6 tempest-VolumesGetTest-1337512028 None] Lock "cinder-a8c8ee17-8ca8-4a75-8aa2-d28adcf0d9bb-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:37 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31" returned: 0 in 0.523s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:37 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31 Apr 09 16:57:37 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:38 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-998b2e17-6a6a-4f5e-9dd1-9371e1667e31" returned: 0 in 0.426s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-quobyte-998b2e17-6a6a-4f5e-9dd1-9371e1667e31" released by "delete_volume" :: held 0.970s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Created reservations ['b04d10ae-0516-45fd-9634-266c062d626c', '9e83ae13-9bdd-43f1-95d3-ba13917b45a7', 'fc817f62-a730-4933-97bb-d23b04a8ae14', 'd95410d6-072b-4a59-904a-d499422c61bb'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:38 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:38 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Flow 'volume_create_manager' (d908722a-0033-4fdd-80b5-7c9b8e865120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:38 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49d0baa-bbdd-4f1b-b6aa-d54e940a513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.452s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:38 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Deleted volume successfully. Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49d0baa-bbdd-4f1b-b6aa-d54e940a513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-562429727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4499e03c-99d5-4999-9009-158ac464e0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea491c2b485473e945c4c7ac4918907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:39Z,use_quota=True,user_id='2ad65baf2bab488ba5a405accf4e7460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe0fd79-cfac-4731-83c0-63741b1a86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe0fd79-cfac-4731-83c0-63741b1a86bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de347e9f-a77e-4eb5-a448-7daf5a807c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de347e9f-a77e-4eb5-a448-7daf5a807c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4499e03c-99d5-4999-9009-158ac464e0d7', 'volume_name': 'volume-4499e03c-99d5-4999-9009-158ac464e0d7', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05742f39-046c-4bd1-8ae3-25e9f287b81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05742f39-046c-4bd1-8ae3-25e9f287b81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7c9fbf-8907-416d-9ce8-10fee4ea9bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:38 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Volume 4499e03c-99d5-4999-9009-158ac464e0d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4499e03c-99d5-4999-9009-158ac464e0d7', 'volume_size': 1} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-562429727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4499e03c-99d5-4999-9009-158ac464e0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea491c2b485473e945c4c7ac4918907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:39Z,use_quota=True,user_id='2ad65baf2bab488ba5a405accf4e7460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Creating volume 4499e03c-99d5-4999-9009-158ac464e0d7 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:38 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-743d58e8-24ac-4bb3-bb2f-bcbefa58688e tempest-VolumesListAdminTestJSON-1950383105 None] Lock "cinder-998b2e17-6a6a-4f5e-9dd1-9371e1667e31-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:38 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 1073741824 Apr 09 16:57:38 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:39 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 1073741824" returned: 0 in 0.559s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:39 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 Apr 09 16:57:39 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:39 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7" returned: 0 in 0.465s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7c9fbf-8907-416d-9ce8-10fee4ea9bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4499e03c-99d5-4999-9009-158ac464e0d7', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6560d3a4-7b49-4da9-b3fa-f26b19a62c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Volume volume-4499e03c-99d5-4999-9009-158ac464e0d7 (4499e03c-99d5-4999-9009-158ac464e0d7): created successfully Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6560d3a4-7b49-4da9-b3fa-f26b19a62c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Flow 'volume_create_manager' (d908722a-0033-4fdd-80b5-7c9b8e865120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:39 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c0ffd6ee-e9d3-47d4-8f1c-3ff6f2d512fb tempest-CinderUnicodeTest-1828986794 None] Created volume successfully. Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Flow 'volume_create_manager' (13183bd4-0c77-46ab-b1df-42da72885573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853c1699-1172-40f8-8662-069e35188375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853c1699-1172-40f8-8662-069e35188375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1192777170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24679261-427a-41ee-bb2f-c998faee0e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fd20878828453ebbf4680e5001601a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:41Z,use_quota=True,user_id='6f6e154ed35e4d8c96e225cffb30b0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67c0cb7-128b-4685-bae6-d46b741addd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67c0cb7-128b-4685-bae6-d46b741addd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902f8276-e925-4764-979b-e1ea6e64a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902f8276-e925-4764-979b-e1ea6e64a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24679261-427a-41ee-bb2f-c998faee0e1b', 'volume_name': 'volume-24679261-427a-41ee-bb2f-c998faee0e1b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a27a3d-782a-4fa0-95ca-50f008a49e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a27a3d-782a-4fa0-95ca-50f008a49e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689420df-4dcb-4709-8b26-fe3d06d3abf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:40 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Volume 24679261-427a-41ee-bb2f-c998faee0e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24679261-427a-41ee-bb2f-c998faee0e1b', 'volume_size': 1} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1192777170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24679261-427a-41ee-bb2f-c998faee0e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fd20878828453ebbf4680e5001601a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:41Z,use_quota=True,user_id='6f6e154ed35e4d8c96e225cffb30b0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Creating volume 24679261-427a-41ee-bb2f-c998faee0e1b {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:40 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:40 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b 1073741824 Apr 09 16:57:40 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:41 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b 1073741824" returned: 0 in 0.573s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:41 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b Apr 09 16:57:41 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:41 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b" returned: 0 in 0.449s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.878s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Creating offline snapshot 692f45f1-98b7-4e4d-9046-092478a15fd3 of volume 4499e03c-99d5-4999-9009-158ac464e0d7 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689420df-4dcb-4709-8b26-fe3d06d3abf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24679261-427a-41ee-bb2f-c998faee0e1b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f09d52-6369-4d7c-86fc-df9f4a55a888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82a4618-549d-4418-917a-f97e446a33e3]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:41 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Volume volume-24679261-427a-41ee-bb2f-c998faee0e1b (24679261-427a-41ee-bb2f-c998faee0e1b): created successfully Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f09d52-6369-4d7c-86fc-df9f4a55a888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Flow 'volume_create_manager' (13183bd4-0c77-46ab-b1df-42da72885573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:41 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-10969fd3-401c-481e-95bb-8831cca0c555 tempest-VolumesNegativeTest-6448655 None] Created volume successfully. Apr 09 16:57:41 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 Apr 09 16:57:41 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:42 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7" returned: 0 in 0.495s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:42 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 1G Apr 09 16:57:42 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:42 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 1G" returned: 0 in 0.579s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4499e03c-99d5-4999-9009-158ac464e0d7 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:42 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4499e03c-99d5-4999-9009-158ac464e0d7 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 Apr 09 16:57:42 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:43 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4499e03c-99d5-4999-9009-158ac464e0d7 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:43 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 is being set with open permissions: ugo+rw Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:43 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 Apr 09 16:57:43 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:43 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3" returned: 0 in 0.521s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Flow 'volume_create_manager' (3763fcaf-ce66-408e-8416-277c01485100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e8feef-3c64-492a-b7d1-61c7a4739720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e8feef-3c64-492a-b7d1-61c7a4739720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1378981161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc4161a-a201-4bbb-aa9b-558d8d2d3df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fabd65c4b74307af701592e3517cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:44Z,use_quota=True,user_id='d9fe740690394acfb7c542cf4a84842e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431332a2-dc20-40e5-9288-28d050b6feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431332a2-dc20-40e5-9288-28d050b6feaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84eb926e-e03c-4936-96b3-1b9a785d513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84eb926e-e03c-4936-96b3-1b9a785d513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc4161a-a201-4bbb-aa9b-558d8d2d3df9', 'volume_name': 'volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd02c57a-84a0-4db5-b5d2-bad37f84f37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd02c57a-84a0-4db5-b5d2-bad37f84f37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7646928f-9a05-4300-91b8-4035142c2568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:44 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Volume 4fc4161a-a201-4bbb-aa9b-558d8d2d3df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9', 'volume_size': 1} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:44 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.info Apr 09 16:57:44 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:44 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.info" returned: 0 in 0.428s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:44 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.info is being set with open permissions: ugo+rw Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:44 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.info Apr 09 16:57:44 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:44 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.info" returned: 0 in 0.399s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1378981161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc4161a-a201-4bbb-aa9b-558d8d2d3df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fabd65c4b74307af701592e3517cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:44Z,use_quota=True,user_id='d9fe740690394acfb7c542cf4a84842e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Creating volume 4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:44 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:44 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 1073741824 Apr 09 16:57:44 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:44 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-bb5cd6d0-98ab-441b-a835-2244aa769892 tempest-CinderUnicodeTest-1828986794 None] Create snapshot completed successfully Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "cinder-692f45f1-98b7-4e4d-9046-092478a15fd3-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-692f45f1-98b7-4e4d-9046-092478a15fd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "cinder-quobyte-4499e03c-99d5-4999-9009-158ac464e0d7" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-quobyte-4499e03c-99d5-4999-9009-158ac464e0d7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "cinder-quobyte-692f45f1-98b7-4e4d-9046-092478a15fd3" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-quobyte-692f45f1-98b7-4e4d-9046-092478a15fd3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Deleting offline snapshot 692f45f1-98b7-4e4d-9046-092478a15fd3 of volume 4499e03c-99d5-4999-9009-158ac464e0d7 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] snapshot_file for this snap is: volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[301496b4-c6dd-4124-8d78-e230c00aac6c]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:45 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 Apr 09 16:57:45 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:45 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 1073741824" returned: 0 in 0.514s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:45 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 Apr 09 16:57:45 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:45 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3" returned: 0 in 0.492s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4499e03c-99d5-4999-9009-158ac464e0d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6ec633-f9c9-4499-86c7-7013255f9153]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:45 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 Apr 09 16:57:45 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:45 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9" returned: 0 in 0.409s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7646928f-9a05-4300-91b8-4035142c2568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ec5ec0-ed55-4ae3-b0c1-b14fc54fecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:45 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Volume volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 (4fc4161a-a201-4bbb-aa9b-558d8d2d3df9): created successfully Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ec5ec0-ed55-4ae3-b0c1-b14fc54fecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Flow 'volume_create_manager' (3763fcaf-ce66-408e-8416-277c01485100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:45 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-02599f98-80d7-419d-8419-eba81289782f tempest-AbsoluteLimitsTests-230393093 None] Created volume successfully. Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Acquiring lock "cinder-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Lock "cinder-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:46 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7" returned: 0 in 0.576s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:46 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 Apr 09 16:57:46 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Acquiring lock "cinder-quobyte-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Lock "cinder-quobyte-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[252d5738-59f8-4ba9-92ab-92e4662bf49f]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:46 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 Apr 09 16:57:46 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:46 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3" returned: 0 in 0.480s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:46 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3 Apr 09 16:57:46 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:46 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9" returned: 0 in 0.495s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:46 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9 Apr 09 16:57:46 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:47 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7.692f45f1-98b7-4e4d-9046-092478a15fd3" returned: 0 in 0.442s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-quobyte-692f45f1-98b7-4e4d-9046-092478a15fd3" released by "_delete_snapshot" :: held 2.042s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-quobyte-4499e03c-99d5-4999-9009-158ac464e0d7" released by "delete_snapshot" :: held 2.058s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:47 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Lock "cinder-quobyte-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9" released by "delete_volume" :: held 0.940s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Created reservations ['3e086c01-3109-4c8b-972a-fcaa68f12265', 'ded13f67-6057-420d-bb46-99f1ca823767', '9210b336-f7df-4c1f-ad65-bd2858d936cd', 'd8dded95-1f55-4f61-a17c-509342bdad4a'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Created reservations ['43be597b-2bdb-41de-a8e2-1ab291ccad72', '2b024038-f493-432c-a46c-7b45d2f9c620', 'c2cac40f-3f02-42f5-9ede-c32d40efe88b', '9baf5c04-59c7-4cc5-8f9e-2a9873fab9e4'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:47 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Delete snapshot completed successfully. Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6947ff9a-5d39-4786-944d-68b71eb7ea4b tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-692f45f1-98b7-4e4d-9046-092478a15fd3-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:47 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:47 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:47 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.426s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:47 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Deleted volume successfully. Apr 09 16:57:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2d928d12-8941-4b8a-bfff-444e2a21a6fe tempest-AbsoluteLimitsTests-230393093 None] Lock "cinder-4fc4161a-a201-4bbb-aa9b-558d8d2d3df9-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "cinder-4499e03c-99d5-4999-9009-158ac464e0d7-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-4499e03c-99d5-4999-9009-158ac464e0d7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "cinder-quobyte-4499e03c-99d5-4999-9009-158ac464e0d7" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-quobyte-4499e03c-99d5-4999-9009-158ac464e0d7" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:48 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd889a40-0469-47e3-aaad-55c9a4c0d579]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:48 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 Apr 09 16:57:48 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:48 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7" returned: 0 in 0.609s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:48 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7 Apr 09 16:57:48 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:49 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4499e03c-99d5-4999-9009-158ac464e0d7" returned: 0 in 0.545s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-quobyte-4499e03c-99d5-4999-9009-158ac464e0d7" released by "delete_volume" :: held 1.194s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Created reservations ['d3bc4f8a-28de-473a-b646-b9546aac73ad', 'ce0deb67-e3a3-4602-bc60-87eea431303f', 'c80ead15-0f8e-4d12-a5dc-03afcc46cb0f', 'a734cb5c-0ed7-4b34-9da1-847845fd29cc'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:49 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:49 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:50 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.466s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:50 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Deleted volume successfully. Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-01f2c292-4e68-4c82-a67b-7e4ddde04bb1 tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-4499e03c-99d5-4999-9009-158ac464e0d7-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "cinder-b46325ba-5ae0-4929-8b70-6b1636a55bf3-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-b46325ba-5ae0-4929-8b70-6b1636a55bf3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "cinder-quobyte-b46325ba-5ae0-4929-8b70-6b1636a55bf3" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-quobyte-b46325ba-5ae0-4929-8b70-6b1636a55bf3" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7aeebd-64f3-4982-afe0-dc89b36f1779]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:50 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 Apr 09 16:57:50 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Flow 'volume_create_manager' (72282a00-262e-47e4-b241-061ee410b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5293d6-7227-4b4b-bdc7-07347be437d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5293d6-7227-4b4b-bdc7-07347be437d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-114324439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bc6673-317a-45de-853e-3ec0b223a237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1fa88190747098b2f5ad448c3f3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:51Z,use_quota=True,user_id='19930c63de064cb3a27612799068c8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954e76d7-aa4e-4686-a370-c7b849fa9156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:51 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954e76d7-aa4e-4686-a370-c7b849fa9156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a6f18f-61d5-43c3-8f70-fc38d68a9356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a6f18f-61d5-43c3-8f70-fc38d68a9356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9bc6673-317a-45de-853e-3ec0b223a237', 'volume_name': 'volume-a9bc6673-317a-45de-853e-3ec0b223a237', 'volume_size': 2}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c676642-71f6-480a-b33a-86d0ad46affc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c676642-71f6-480a-b33a-86d0ad46affc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d27f805-1e14-4700-8004-58ca3f46d4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:51 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Volume a9bc6673-317a-45de-853e-3ec0b223a237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9bc6673-317a-45de-853e-3ec0b223a237', 'volume_size': 2} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-114324439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bc6673-317a-45de-853e-3ec0b223a237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1fa88190747098b2f5ad448c3f3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:51Z,use_quota=True,user_id='19930c63de064cb3a27612799068c8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Creating volume a9bc6673-317a-45de-853e-3ec0b223a237 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:51 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 2147483648 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3" returned: 0 in 0.563s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:51 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 2147483648 Apr 09 16:57:51 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:51 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3 Apr 09 16:57:51 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:51 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 2147483648" returned: 0 in 0.505s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:51 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b46325ba-5ae0-4929-8b70-6b1636a55bf3" returned: 0 in 0.506s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-quobyte-b46325ba-5ae0-4929-8b70-6b1636a55bf3" released by "delete_volume" :: held 1.101s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:51 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 Apr 09 16:57:51 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Created reservations ['5264f485-002e-45a0-9a29-2ccb9e53627a', 'b816dd75-e98a-4fe2-8694-06bc63ebebcb', 'f4959e6c-0347-431e-9dc5-22c4b887dc24', 'a7b2fb1e-bf04-40d4-b09b-c70303ee52f9'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:51 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:51 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:52 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237" returned: 0 in 0.460s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d27f805-1e14-4700-8004-58ca3f46d4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9bc6673-317a-45de-853e-3ec0b223a237', 'volume_size': 2}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a61699-b1d6-4cd2-9522-98555157823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:52 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Volume volume-a9bc6673-317a-45de-853e-3ec0b223a237 (a9bc6673-317a-45de-853e-3ec0b223a237): created successfully Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a61699-b1d6-4cd2-9522-98555157823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Flow 'volume_create_manager' (72282a00-262e-47e4-b241-061ee410b462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-dadf84b9-da67-498c-b9ea-026a16cf25d7 tempest-VolumesCloneNegativeTest-281935287 None] Created volume successfully. Apr 09 16:57:52 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.451s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Deleted volume successfully. Apr 09 16:57:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3c84b29f-a672-4daa-a3e8-a341a06575e5 tempest-CinderUnicodeTest-1828986794 None] Lock "cinder-b46325ba-5ae0-4929-8b70-6b1636a55bf3-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Acquiring lock "cinder-a9bc6673-317a-45de-853e-3ec0b223a237-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Lock "cinder-a9bc6673-317a-45de-853e-3ec0b223a237-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Acquiring lock "cinder-quobyte-a9bc6673-317a-45de-853e-3ec0b223a237" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:57:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Lock "cinder-quobyte-a9bc6673-317a-45de-853e-3ec0b223a237" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:57:53 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb88f01-a8c6-4951-a076-ceb02175a413]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:53 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 Apr 09 16:57:53 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:53 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237" returned: 0 in 0.522s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:53 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237 Apr 09 16:57:53 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:54 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-a9bc6673-317a-45de-853e-3ec0b223a237" returned: 0 in 0.572s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Lock "cinder-quobyte-a9bc6673-317a-45de-853e-3ec0b223a237" released by "delete_volume" :: held 1.142s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Created reservations ['590c9383-6407-4b86-bc4f-aec822454c1e', 'ce6444d3-1429-4f6c-bdc3-a110b3cf7ba6', '7c3eefb9-53a5-4f4c-a104-cc17fefe57e3', '98b31262-724c-4098-9211-256d2c795b62'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:54 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:57:54 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:54 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.451s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:57:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Deleted volume successfully. Apr 09 16:57:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-aca1f530-d54e-4eba-b1ff-e48390752b57 tempest-VolumesCloneNegativeTest-281935287 None] Lock "cinder-a9bc6673-317a-45de-853e-3ec0b223a237-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Flow 'volume_create_manager' (e8ede2a3-3a41-4689-bbb9-7df44562f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a09fb1-8f24-4a10-aa83-df3e570f7715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a09fb1-8f24-4a10-aa83-df3e570f7715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1197010431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bac3834-5c24-4369-82b4-a151db338ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad3bdee6bfd487f808b9c453a349e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:57Z,use_quota=True,user_id='bfe19a1d7dc04d7b84f66a52bf58f6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3638c92-0df9-4c5e-b9cc-41e4335f07c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3638c92-0df9-4c5e-b9cc-41e4335f07c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab67b3a-efef-4bc6-9e88-ed37cdccf76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.image.glance [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Creating Keystone auth plugin from conf {{(pid=82139) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab67b3a-efef-4bc6-9e88-ed37cdccf76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bac3834-5c24-4369-82b4-a151db338ec1', 'volume_name': 'volume-0bac3834-5c24-4369-82b4-a151db338ec1', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c780c976-cc71-4cbe-9e9a-61f66920d095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c780c976-cc71-4cbe-9e9a-61f66920d095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0beb26f2-cecd-4cea-847f-53d37f4b8876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:57:57 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Volume 0bac3834-5c24-4369-82b4-a151db338ec1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bac3834-5c24-4369-82b4-a151db338ec1', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Trying to clone 0bac3834-5c24-4369-82b4-a151db338ec1 from image d01216e8-c5dc-4c96-8184-f8935064d568 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]). {{(pid=82139) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 16:57:57 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Image download 20.69 MB at 20.69 MB/s Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac760666-6f3e-49b4-b621-0bf1c7cb9923]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:57 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD Apr 09 16:57:57 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:58 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD" returned: 0 in 0.561s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Temporary image d01216e8-c5dc-4c96-8184-f8935064d568 is fetched for user bfe19a1d7dc04d7b84f66a52bf58f6dc. {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab2f09b-0971-4d47-892e-05c05d0cf239]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:58 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD Apr 09 16:57:58 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:58 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1197010431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bac3834-5c24-4369-82b4-a151db338ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad3bdee6bfd487f808b9c453a349e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:57:57Z,use_quota=True,user_id='bfe19a1d7dc04d7b84f66a52bf58f6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Creating volume 0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:57:58 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:57:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:58 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 1073741824 Apr 09 16:57:58 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:59 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 1073741824" returned: 0 in 0.514s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:57:59 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:57:59 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:57:59 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Apr 09 16:57:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 0 in 0.475s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:57:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:57:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:57:59 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Attempting download of d01216e8-c5dc-4c96-8184-f8935064d568 ((None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}])) to volume 0bac3834-5c24-4369-82b4-a151db338ec1. {{(pid=82139) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 16:58:00 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e78294-6204-4ba3-936c-c5c1f016a258]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_v45m7kki {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:00 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_v45m7kki Apr 09 16:58:00 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:00 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_v45m7kki" returned: 0 in 0.455s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_v45m7kki {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:00 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_v45m7kki Apr 09 16:58:00 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:00 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_v45m7kki" returned: 1 in 0.477s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d01216e8-c5dc-4c96-8184-f8935064d568_v45m7kki' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:58:00 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8306f72-10bf-4d03-bec2-be846cabdca2]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:01 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD Apr 09 16:58:01 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:01 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:01 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] d01216e8-c5dc-4c96-8184-f8935064d568 was qcow2, converting to raw {{(pid=82139) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 16:58:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:01 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:58:01 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:02 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 0 in 0.861s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:02 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d01216e8-c5dc-4c96-8184-f8935064d568__qfnjy1fdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:58:02 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Converted 112.00 MB image at 112.00 MB/s Apr 09 16:58:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:02 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 1G Apr 09 16:58:02 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:02 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 1G" returned: 0 in 0.416s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5decaf3-8445-49cb-b601-4b5f4fd83027]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:02 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:58:02 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:03 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 0 in 0.530s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:03 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:58:03 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:03 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 1 in 0.537s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Downloaded image d01216e8-c5dc-4c96-8184-f8935064d568 ((None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}])) to volume 0bac3834-5c24-4369-82b4-a151db338ec1 successfully. {{(pid=82139) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Temporary image d01216e8-c5dc-4c96-8184-f8935064d568 for user bfe19a1d7dc04d7b84f66a52bf58f6dc is deleted. {{(pid=82139) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.volume.volume_utils [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Marking volume 0bac3834-5c24-4369-82b4-a151db338ec1 as bootable. {{(pid=82139) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Copying metadata from image d01216e8-c5dc-4c96-8184-f8935064d568 to 0bac3834-5c24-4369-82b4-a151db338ec1. {{(pid=82139) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Creating volume glance metadata for volume 0bac3834-5c24-4369-82b4-a151db338ec1 backed by image d01216e8-c5dc-4c96-8184-f8935064d568 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82139) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0beb26f2-cecd-4cea-847f-53d37f4b8876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bac3834-5c24-4369-82b4-a151db338ec1', 'volume_size': 1, 'image_id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d01216e8-c5dc-4c96-8184-f8935064d568', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d82ccd52751472291ca8497fa877337', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd01216e8-c5dc-4c96-8184-f8935064d568', 'created_at': datetime.datetime(2026, 4, 9, 14, 46, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 14, 46, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d01216e8-c5dc-4c96-8184-f8935064d568/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef48f2a7-ad8e-46f3-9286-f5b9ac093c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:03 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Volume volume-0bac3834-5c24-4369-82b4-a151db338ec1 (0bac3834-5c24-4369-82b4-a151db338ec1): created successfully Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef48f2a7-ad8e-46f3-9286-f5b9ac093c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Flow 'volume_create_manager' (e8ede2a3-3a41-4689-bbb9-7df44562f836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-658e6cd9-c72d-432d-90a9-6cce1826674c tempest-VolumesExtendTest-1136201680 None] Created volume successfully. Apr 09 16:58:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:04 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[911c024e-4a82-415b-8958-7d588bcf045e]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:04 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:58:04 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:04 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 0 in 0.459s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:04 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:58:04 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:05 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 1 in 0.488s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 2G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 2G" returned: 0 in 0.043s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.021s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:05 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-5cc32f80-b2db-439a-ab79-265f1746c970 tempest-VolumesExtendTest-1136201680 None] Extend volume completed successfully. Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "cinder-0bac3834-5c24-4369-82b4-a151db338ec1-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Lock "cinder-0bac3834-5c24-4369-82b4-a151db338ec1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "cinder-quobyte-0bac3834-5c24-4369-82b4-a151db338ec1" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Lock "cinder-quobyte-0bac3834-5c24-4369-82b4-a151db338ec1" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5494653c-86de-4125-8863-870540eef6cc]: (4, 'raw') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:05 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:58:05 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:05 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 0 in 0.504s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:05 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:58:05 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:06 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 1 in 0.593s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1' failed. Not Retrying. {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:06 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1 Apr 09 16:58:06 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:06 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0bac3834-5c24-4369-82b4-a151db338ec1" returned: 0 in 0.422s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Lock "cinder-quobyte-0bac3834-5c24-4369-82b4-a151db338ec1" released by "delete_volume" :: held 1.569s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Acquiring lock "cinder-24679261-427a-41ee-bb2f-c998faee0e1b-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Lock "cinder-24679261-427a-41ee-bb2f-c998faee0e1b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Acquiring lock "cinder-quobyte-24679261-427a-41ee-bb2f-c998faee0e1b" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Lock "cinder-quobyte-24679261-427a-41ee-bb2f-c998faee0e1b" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6a659e-1b54-48c2-a12c-85459e9f84df]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Created reservations ['c48993e5-2ea2-45f6-8efa-9efe26475166', '83b3a800-ee6b-477d-a2d1-236933048931', 'a27e17ea-5a0b-45f1-b23e-4eeab3c6cb3f', 'b9049af3-3a75-4fa4-b208-1c1c318d0089'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:07 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b Apr 09 16:58:07 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:07 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:58:07 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:07 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b" returned: 0 in 0.466s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:07 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.422s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:58:07 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Deleted volume successfully. Apr 09 16:58:07 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b Apr 09 16:58:07 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-21b1de4d-5018-4e8f-b517-c82688b447e8 tempest-VolumesExtendTest-1136201680 None] Lock "cinder-0bac3834-5c24-4369-82b4-a151db338ec1-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Flow 'volume_create_manager' (fd0010d8-8b15-47a2-ab0d-7c40b372b15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4754d2d-b78b-436b-9478-97459b98e6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4754d2d-b78b-436b-9478-97459b98e6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1975812652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427968ba-1d5c-4fab-b297-6ef9feb9f8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad3bdee6bfd487f808b9c453a349e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:08Z,use_quota=True,user_id='bfe19a1d7dc04d7b84f66a52bf58f6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550116ee-e146-4482-a375-e57521fc71ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550116ee-e146-4482-a375-e57521fc71ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c3e3db-6426-4c87-b9c3-ae9d25286c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c3e3db-6426-4c87-b9c3-ae9d25286c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427968ba-1d5c-4fab-b297-6ef9feb9f8a4', 'volume_name': 'volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c617cac-1a9d-47f2-8a95-4342dca80052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c617cac-1a9d-47f2-8a95-4342dca80052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817f45ca-6a1d-4082-8e67-44576bb50309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:07 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Volume 427968ba-1d5c-4fab-b297-6ef9feb9f8a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4', 'volume_size': 1} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1975812652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427968ba-1d5c-4fab-b297-6ef9feb9f8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad3bdee6bfd487f808b9c453a349e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:08Z,use_quota=True,user_id='bfe19a1d7dc04d7b84f66a52bf58f6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Creating volume 427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:58:07 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:07 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 1073741824 Apr 09 16:58:07 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:07 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-24679261-427a-41ee-bb2f-c998faee0e1b" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Lock "cinder-quobyte-24679261-427a-41ee-bb2f-c998faee0e1b" released by "delete_volume" :: held 0.912s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Created reservations ['3d781e76-b6a4-46c3-9227-38f811b11733', '34d161aa-11fe-4f8e-820d-60b39425019b', '645c7925-3668-475d-9657-416ff70b67b2', 'f1e09bd8-72d8-4fb1-a27c-1dec553d8241'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:07 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:58:07 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:08 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 1073741824" returned: 0 in 0.554s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:08 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 Apr 09 16:58:08 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:08 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.482s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:58:08 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Deleted volume successfully. Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4bef490d-9a02-46ed-b454-6f9b0f62d380 tempest-VolumesNegativeTest-6448655 None] Lock "cinder-24679261-427a-41ee-bb2f-c998faee0e1b-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:08 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" returned: 0 in 0.477s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817f45ca-6a1d-4082-8e67-44576bb50309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b49af9-8093-43df-9fa5-4ce7a82bace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:08 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Volume volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 (427968ba-1d5c-4fab-b297-6ef9feb9f8a4): created successfully Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b49af9-8093-43df-9fa5-4ce7a82bace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Flow 'volume_create_manager' (fd0010d8-8b15-47a2-ab0d-7c40b372b15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:08 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c790c668-2960-4be4-a04e-a60981697f28 tempest-VolumesExtendTest-1136201680 None] Created volume successfully. Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Flow 'volume_create_manager' (26759fee-3c00-46df-992e-493491ad1396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72feafb6-38b3-4967-8e84-f1c01dce768a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72feafb6-38b3-4967-8e84-f1c01dce768a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-352397478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcb19e3-dd1d-408a-b800-cf2bec9b8e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e94b857fc204baf8c9ebcdaf498cab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:10Z,use_quota=True,user_id='d2214134e31a4cfe8ab50c9cd92179b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ec25fc-68ac-4c18-bcfc-2a6728a04a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ec25fc-68ac-4c18-bcfc-2a6728a04a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14abbe9-ad82-4344-a2a6-9cfe0eef3773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14abbe9-ad82-4344-a2a6-9cfe0eef3773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bcb19e3-dd1d-408a-b800-cf2bec9b8e13', 'volume_name': 'volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13', 'volume_size': 2}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c735a963-9367-472c-8269-b32d1585fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c735a963-9367-472c-8269-b32d1585fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5a9db8-9bba-461f-9a6b-3d9074a4321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:09 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Volume 7bcb19e3-dd1d-408a-b800-cf2bec9b8e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13', 'volume_size': 2} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-352397478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcb19e3-dd1d-408a-b800-cf2bec9b8e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e94b857fc204baf8c9ebcdaf498cab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:10Z,use_quota=True,user_id='d2214134e31a4cfe8ab50c9cd92179b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Creating volume 7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:58:09 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 2147483648 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:09 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 2147483648 Apr 09 16:58:09 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:10 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 2147483648" returned: 0 in 0.509s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:10 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 Apr 09 16:58:10 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:10 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" returned: 0 in 0.403s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.675s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5a9db8-9bba-461f-9a6b-3d9074a4321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13', 'volume_size': 2}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26e78f9-ee56-48ce-a7aa-6b3c65b745d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Creating offline snapshot 116957ba-8c36-41c3-b70b-570e5e99481a of volume 427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9efbbd-9e87-4afe-9017-9c0edeccedf2]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:10 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Volume volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 (7bcb19e3-dd1d-408a-b800-cf2bec9b8e13): created successfully Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26e78f9-ee56-48ce-a7aa-6b3c65b745d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Flow 'volume_create_manager' (26759fee-3c00-46df-992e-493491ad1396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:10 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1d1d3010-c5d0-43b9-82e8-b89485a1401b tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Created volume successfully. Apr 09 16:58:10 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 Apr 09 16:58:10 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:11 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" returned: 0 in 0.492s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:11 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a 1G Apr 09 16:58:11 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:11 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a 1G" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:11 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a Apr 09 16:58:11 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:12 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a" returned: 0 in 0.490s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:12 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a is being set with open permissions: ugo+rw Apr 09 16:58:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:12 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a Apr 09 16:58:12 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:12 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a" returned: 0 in 0.395s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:12 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.info Apr 09 16:58:12 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:12 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.info" returned: 0 in 0.413s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:12 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.info is being set with open permissions: ugo+rw Apr 09 16:58:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:12 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.info Apr 09 16:58:12 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:13 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.info" returned: 0 in 0.406s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.729s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.502s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Creating offline snapshot 7f46a542-2733-4edb-a063-7dc34711ce7d of volume 7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:58:13 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-22d1886e-652c-4e49-b758-11a5fafcc25e tempest-VolumesExtendTest-1136201680 None] Create snapshot completed successfully Apr 09 16:58:13 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbef7c0-382b-4a5d-9c73-d3c6d4f42e71]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:13 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 Apr 09 16:58:13 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:13 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" returned: 0 in 0.456s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d 2G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:13 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d 2G Apr 09 16:58:13 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:14 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:58:14 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0cb4ed1a-b2af-4fac-b6b6-526c14579670 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:14 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d 2G" returned: 0 in 0.523s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:14 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d Apr 09 16:58:14 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:14 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.455s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:58:14 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d" returned: 0 in 0.413s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:14 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d is being set with open permissions: ugo+rw Apr 09 16:58:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:14 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d Apr 09 16:58:14 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:15 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d" returned: 0 in 0.416s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:15 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.info Apr 09 16:58:15 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:15 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.info" returned: 0 in 0.401s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:15 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.info is being set with open permissions: ugo+rw Apr 09 16:58:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:15 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.info Apr 09 16:58:15 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:16 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.info" returned: 0 in 0.413s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0cb4ed1a-b2af-4fac-b6b6-526c14579670 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.872s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5475f5a6-ce16-4e10-8b7f-61f415983739]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0cb4ed1a-b2af-4fac-b6b6-526c14579670 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e888f0fc-1b48-47b8-8099-8cb88237e13f tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Create snapshot completed successfully Apr 09 16:58:16 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 Apr 09 16:58:16 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:16 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0cb4ed1a-b2af-4fac-b6b6-526c14579670 tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" returned: 0 in 0.475s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0cb4ed1a-b2af-4fac-b6b6-526c14579670 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a 2G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0cb4ed1a-b2af-4fac-b6b6-526c14579670 tempest-VolumesExtendTest-1136201680 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a 2G" returned: 0 in 0.056s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0cb4ed1a-b2af-4fac-b6b6-526c14579670 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.549s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-0cb4ed1a-b2af-4fac-b6b6-526c14579670 tempest-VolumesExtendTest-1136201680 None] Extend volume completed successfully. Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "cinder-7f46a542-2733-4edb-a063-7dc34711ce7d-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-7f46a542-2733-4edb-a063-7dc34711ce7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "cinder-quobyte-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-quobyte-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "cinder-quobyte-7f46a542-2733-4edb-a063-7dc34711ce7d" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-quobyte-7f46a542-2733-4edb-a063-7dc34711ce7d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Deleting offline snapshot 7f46a542-2733-4edb-a063-7dc34711ce7d of volume 7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] snapshot_file for this snap is: volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60429b0-7874-4fd8-b3fc-ef7e2a8b0b28]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:17 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d Apr 09 16:58:17 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Acquiring lock "cinder-116957ba-8c36-41c3-b70b-570e5e99481a-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Lock "cinder-116957ba-8c36-41c3-b70b-570e5e99481a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Acquiring lock "cinder-quobyte-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Lock "cinder-quobyte-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Acquiring lock "cinder-quobyte-116957ba-8c36-41c3-b70b-570e5e99481a" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Lock "cinder-quobyte-116957ba-8c36-41c3-b70b-570e5e99481a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Deleting offline snapshot 116957ba-8c36-41c3-b70b-570e5e99481a of volume 427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] snapshot_file for this snap is: volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a05dd6-3dac-4f3a-8f68-e9853ca031f3]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:17 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a Apr 09 16:58:17 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:17 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d" returned: 0 in 0.494s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370a8fb-b5ca-4218-8981-533683bca8d3]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:17 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 Apr 09 16:58:17 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:17 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a" returned: 0 in 0.464s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67c8f05-30e1-49a0-8f87-314209fb6919]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:18 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 Apr 09 16:58:18 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:18 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" returned: 0 in 0.461s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:18 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d Apr 09 16:58:18 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:18 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" returned: 0 in 0.479s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:18 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a Apr 09 16:58:18 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:18 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d" returned: 0 in 0.450s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:18 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d Apr 09 16:58:18 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:18 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:18 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a Apr 09 16:58:18 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:18 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13.7f46a542-2733-4edb-a063-7dc34711ce7d" returned: 0 in 0.436s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-quobyte-7f46a542-2733-4edb-a063-7dc34711ce7d" released by "_delete_snapshot" :: held 1.895s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-quobyte-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" released by "delete_snapshot" :: held 1.908s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=211,cinder:SELECT=157,cinder:INSERT=67,cinder:DELETE=18 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Created reservations ['47157d69-8d48-4f7f-bbfc-d29031e96d75', '73d552ae-8f82-428a-9234-da00592cc2be', 'bfeab6c7-7652-4443-b25a-3324edd084b6', '551f5e84-1128-482e-807c-e3b3bb9367e5'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:19 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Delete snapshot completed successfully. Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-114a517c-bb9b-4b39-89a4-fbaedff0dbb7 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-7f46a542-2733-4edb-a063-7dc34711ce7d-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "cinder-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "cinder-quobyte-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-quobyte-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c56f24-6153-48a1-a4a8-c2c83197caf7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:19 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 Apr 09 16:58:19 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:19 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4.116957ba-8c36-41c3-b70b-570e5e99481a" returned: 0 in 0.457s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Lock "cinder-quobyte-116957ba-8c36-41c3-b70b-570e5e99481a" released by "_delete_snapshot" :: held 1.919s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Lock "cinder-quobyte-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" released by "delete_snapshot" :: held 1.932s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Created reservations ['c8825ad7-5cda-4ce8-8e38-a189eb631e70', '1a9ab4ab-c319-4026-938f-df0fff10ad45', 'af2b2618-e49d-41c8-b0d7-e011350f8422', 'a04733c6-2e77-4035-919a-9dc99e38ecf3'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:19 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Delete snapshot completed successfully. Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-72512955-a135-40ca-aeaf-acee395c2e5d tempest-VolumesExtendTest-1136201680 None] Lock "cinder-116957ba-8c36-41c3-b70b-570e5e99481a-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "cinder-427968ba-1d5c-4fab-b297-6ef9feb9f8a4-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Lock "cinder-427968ba-1d5c-4fab-b297-6ef9feb9f8a4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "cinder-quobyte-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Lock "cinder-quobyte-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff51417f-9136-40c4-a021-e8e257af0ea8]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:19 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 Apr 09 16:58:19 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:19 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" returned: 0 in 0.497s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:19 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13 Apr 09 16:58:19 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:20 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" returned: 0 in 0.466s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:20 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4 Apr 09 16:58:20 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:20 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" returned: 0 in 0.439s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-quobyte-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13" released by "delete_volume" :: held 0.969s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=160,cinder:INSERT=55,cinder:UPDATE=204,cinder:DELETE=18 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Created reservations ['3717972b-aa5a-447d-ba09-2160f1d4b817', 'f42a01cc-8612-4454-9859-ba7332c7f19c', '774799e5-ae66-4927-b40c-87abc198824f', 'cb28748d-4f33-4d84-bd90-ef67cfe74f1f'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:20 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:58:20 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:20 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" returned: 0 in 0.476s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Lock "cinder-quobyte-427968ba-1d5c-4fab-b297-6ef9feb9f8a4" released by "delete_volume" :: held 0.982s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Created reservations ['2b0748c2-22ab-4680-a32a-abd90e0c1900', '26e3ae07-5a26-4a87-9118-9927e82a58e9', '929e55bf-cee2-470f-b5e6-ec0db887d3ff', '276a3fc3-431b-4142-93e8-b8d0493171ec'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:20 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:58:20 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:20 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.536s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:58:20 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Deleted volume successfully. Apr 09 16:58:20 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c99f7a3f-7731-42d8-9fa3-252ff0984fa6 tempest-VolumesSnapshotNegativeTestJSON-640925813 None] Lock "cinder-7bcb19e3-dd1d-408a-b800-cf2bec9b8e13-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:21 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.559s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:21 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:58:21 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Deleted volume successfully. Apr 09 16:58:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc1b132b-1cf5-4c29-ac10-1e1b7a66e5f2 tempest-VolumesExtendTest-1136201680 None] Lock "cinder-427968ba-1d5c-4fab-b297-6ef9feb9f8a4-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (ce30f3f0-1186-4a0c-9701-4441bbf0d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa9816e-cebd-4985-acb2-4b2fb3aaf3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa9816e-cebd-4985-acb2-4b2fb3aaf3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2081381973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d20debb-7ebf-4c2e-b7c8-1a3c27eea280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8a6aeebece4809b43d3af1df387912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:32Z,use_quota=True,user_id='94af5ada48ce4f21b19f6900dfe24526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6e7aaf-1b96-426c-b7e6-eb29b6a532fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6e7aaf-1b96-426c-b7e6-eb29b6a532fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5d6459-ec75-460e-b015-855008f47171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5d6459-ec75-460e-b015-855008f47171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d20debb-7ebf-4c2e-b7c8-1a3c27eea280', 'volume_name': 'volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d98f4c7-c7dd-4032-8a72-7a7a1159cd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d98f4c7-c7dd-4032-8a72-7a7a1159cd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afc73dc-fb0b-47d5-87cf-eeacf05051d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:32 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Volume 1d20debb-7ebf-4c2e-b7c8-1a3c27eea280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280', 'volume_size': 1} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2081381973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d20debb-7ebf-4c2e-b7c8-1a3c27eea280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8a6aeebece4809b43d3af1df387912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:32Z,use_quota=True,user_id='94af5ada48ce4f21b19f6900dfe24526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Creating volume 1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:58:32 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:58:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:32 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 1073741824 Apr 09 16:58:32 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:33 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 1073741824" returned: 0 in 0.611s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:33 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 Apr 09 16:58:33 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:33 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" returned: 0 in 0.514s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afc73dc-fb0b-47d5-87cf-eeacf05051d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c7a92f-e8e8-40ce-b6de-3e1d8c8a43d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:33 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Volume volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 (1d20debb-7ebf-4c2e-b7c8-1a3c27eea280): created successfully Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c7a92f-e8e8-40ce-b6de-3e1d8c8a43d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:33 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (ce30f3f0-1186-4a0c-9701-4441bbf0d77a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-eb76b230-5090-4868-abd3-4aaaa2eef516 tempest-VolumesSnapshotTestJSON-814736045 None] Created volume successfully. Apr 09 16:58:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Creating offline snapshot 469b192e-2e00-4fa0-8621-8b6eb25ea361 of volume 1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:58:34 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ab7a67-016c-4f25-94df-066ba5e6b256]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:34 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 Apr 09 16:58:34 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:35 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" returned: 0 in 0.500s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:35 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 1G Apr 09 16:58:35 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:35 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 1G" returned: 0 in 0.516s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:35 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 Apr 09 16:58:35 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:36 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361" returned: 0 in 0.461s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:36 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 is being set with open permissions: ugo+rw Apr 09 16:58:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:36 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 Apr 09 16:58:36 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:36 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361" returned: 0 in 0.422s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:36 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.info Apr 09 16:58:36 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:37 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.info" returned: 0 in 0.446s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:37 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.info is being set with open permissions: ugo+rw Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:37 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.info Apr 09 16:58:37 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:37 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.info" returned: 0 in 0.452s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:37 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c0d9c8fb-6672-4917-ac3f-b330167d7904 tempest-VolumesSnapshotTestJSON-814736045 None] Create snapshot completed successfully Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Flow 'volume_create_manager' (2c954ce1-b8ea-4c7b-bd5d-790a0dfa6567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b0f366-51cf-4181-a226-8a237602f34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b0f366-51cf-4181-a226-8a237602f34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-632671940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da15892b-7ba3-445e-b01c-8f186a037ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907af0c4ae3a444092f562522aad5054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:38Z,use_quota=True,user_id='3402d886e11149e983ae5d1397c15d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c33dd85-d38c-4e01-b9f5-5dde0c6125d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c33dd85-d38c-4e01-b9f5-5dde0c6125d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1504c12-ce03-41a6-a2d3-42620cbabe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1504c12-ce03-41a6-a2d3-42620cbabe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da15892b-7ba3-445e-b01c-8f186a037ef5', 'volume_name': 'volume-da15892b-7ba3-445e-b01c-8f186a037ef5', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f184dd-655e-4c48-9768-87d09d8c306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f184dd-655e-4c48-9768-87d09d8c306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e04076-8d0a-4a7e-b96c-3ec94dc846ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:37 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Volume da15892b-7ba3-445e-b01c-8f186a037ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da15892b-7ba3-445e-b01c-8f186a037ef5', 'volume_size': 1} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-632671940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da15892b-7ba3-445e-b01c-8f186a037ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907af0c4ae3a444092f562522aad5054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:38Z,use_quota=True,user_id='3402d886e11149e983ae5d1397c15d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Creating volume da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:58:37 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-469b192e-2e00-4fa0-8621-8b6eb25ea361-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:37 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 1073741824 Apr 09 16:58:37 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-469b192e-2e00-4fa0-8621-8b6eb25ea361-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-469b192e-2e00-4fa0-8621-8b6eb25ea361" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-469b192e-2e00-4fa0-8621-8b6eb25ea361" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Deleting offline snapshot 469b192e-2e00-4fa0-8621-8b6eb25ea361 of volume 1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] snapshot_file for this snap is: volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b588af6-bcc8-4680-baa5-debd244194dd]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:38 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 Apr 09 16:58:38 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:38 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 1073741824" returned: 0 in 0.475s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:38 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 Apr 09 16:58:38 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:38 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361" returned: 0 in 0.489s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf547f-e64e-4a03-9d5b-f698d728f07b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:38 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 Apr 09 16:58:38 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:38 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5" returned: 0 in 0.452s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e04076-8d0a-4a7e-b96c-3ec94dc846ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da15892b-7ba3-445e-b01c-8f186a037ef5', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21aa3f3-c168-426f-9c6e-874266711166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:38 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Volume volume-da15892b-7ba3-445e-b01c-8f186a037ef5 (da15892b-7ba3-445e-b01c-8f186a037ef5): created successfully Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21aa3f3-c168-426f-9c6e-874266711166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Flow 'volume_create_manager' (2c954ce1-b8ea-4c7b-bd5d-790a0dfa6567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:38 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-57a4d36f-6c05-4b11-8ed8-975854769b05 tempest-SnapshotDependencyTests-946741140 None] Created volume successfully. Apr 09 16:58:39 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" returned: 0 in 0.554s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:39 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 Apr 09 16:58:39 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:39 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361" returned: 0 in 0.459s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:39 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361 Apr 09 16:58:39 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:39 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280.469b192e-2e00-4fa0-8621-8b6eb25ea361" returned: 0 in 0.403s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-469b192e-2e00-4fa0-8621-8b6eb25ea361" released by "_delete_snapshot" :: held 1.961s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" released by "delete_snapshot" :: held 1.973s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Created reservations ['a8ca81b0-7ba3-4bc4-b5df-c79fbc24ca5c', '0ba214ce-e9b8-47bd-88c1-342d7a31b121', '33010f29-9716-4233-b29e-10910ad7af91', '4ce0ab13-a646-491a-a4ac-4dc979717650'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:40 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Delete snapshot completed successfully. Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-30f0be29-a026-4a6e-b5fb-51792737cb0c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-469b192e-2e00-4fa0-8621-8b6eb25ea361-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Creating offline snapshot 35ab5910-8bdd-41b0-b5da-58b62406a42c of volume da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b6b231-cace-4e46-ac9c-c1df43ea6d80]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:40 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 Apr 09 16:58:40 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:40 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5" returned: 0 in 0.455s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:40 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c 1G Apr 09 16:58:40 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:41 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c 1G" returned: 0 in 0.509s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da15892b-7ba3-445e-b01c-8f186a037ef5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:41 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da15892b-7ba3-445e-b01c-8f186a037ef5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c Apr 09 16:58:41 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (54eaa2c0-521c-44ed-a8c9-a1e9255143f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3531fcef-f21b-468f-b0b6-99b2732c8b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3531fcef-f21b-468f-b0b6-99b2732c8b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1522883234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d44293b-610c-4767-9c8b-e9c61f119fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8a6aeebece4809b43d3af1df387912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:41Z,use_quota=True,user_id='94af5ada48ce4f21b19f6900dfe24526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc11b25-8102-46d2-b609-e8a95cdfabd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc11b25-8102-46d2-b609-e8a95cdfabd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a894f7d-61ac-4e98-a06b-898bab8a2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a894f7d-61ac-4e98-a06b-898bab8a2e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d44293b-610c-4767-9c8b-e9c61f119fab', 'volume_name': 'volume-0d44293b-610c-4767-9c8b-e9c61f119fab', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b6cebf-dcc2-4312-a600-712b065f222e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b6cebf-dcc2-4312-a600-712b065f222e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a20837b-b8c1-4f9d-9e12-d3e76cfbbbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:41 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Volume 0d44293b-610c-4767-9c8b-e9c61f119fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d44293b-610c-4767-9c8b-e9c61f119fab', 'volume_size': 1} Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:41 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da15892b-7ba3-445e-b01c-8f186a037ef5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c" returned: 0 in 0.456s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:41 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c is being set with open permissions: ugo+rw Apr 09 16:58:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:41 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c Apr 09 16:58:41 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:42 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c" returned: 0 in 0.394s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:42 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.info Apr 09 16:58:42 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:42 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.info" returned: 0 in 0.428s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:42 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.info is being set with open permissions: ugo+rw Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:42 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.info Apr 09 16:58:42 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:42 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.info" returned: 0 in 0.401s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1522883234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d44293b-610c-4767-9c8b-e9c61f119fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8a6aeebece4809b43d3af1df387912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:41Z,use_quota=True,user_id='94af5ada48ce4f21b19f6900dfe24526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Creating volume 0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:58:42 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:58:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:42 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab 1073741824 Apr 09 16:58:42 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:42 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-224ba493-8a59-460a-92a6-e4e031447e76 tempest-SnapshotDependencyTests-946741140 None] Create snapshot completed successfully Apr 09 16:58:43 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab 1073741824" returned: 0 in 0.502s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:43 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab Apr 09 16:58:43 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Flow 'volume_create_manager' (f3cd39ba-1fc4-41ea-90cb-67df23db202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54580376-78bf-4aff-b710-0e6948cbc217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54580376-78bf-4aff-b710-0e6948cbc217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6542e263-7bce-4429-8f28-375a9ee44028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907af0c4ae3a444092f562522aad5054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35ab5910-8bdd-41b0-b5da-58b62406a42c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:44Z,use_quota=True,user_id='3402d886e11149e983ae5d1397c15d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6dd0f9-c384-4497-acc7-104fe5c4027f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6dd0f9-c384-4497-acc7-104fe5c4027f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d67e63-1f89-46b4-a962-1bcc63427b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d67e63-1f89-46b4-a962-1bcc63427b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6542e263-7bce-4429-8f28-375a9ee44028', 'volume_name': 'volume-6542e263-7bce-4429-8f28-375a9ee44028', 'volume_size': 1, 'snapshot_id': '35ab5910-8bdd-41b0-b5da-58b62406a42c'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54a02c9-b3b9-4bc4-b231-6473e970603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54a02c9-b3b9-4bc4-b231-6473e970603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1831510a-6208-473e-9b75-af762c425de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:43 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Volume 6542e263-7bce-4429-8f28-375a9ee44028: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6542e263-7bce-4429-8f28-375a9ee44028', 'volume_size': 1, 'snapshot_id': '35ab5910-8bdd-41b0-b5da-58b62406a42c'} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:43 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab" returned: 0 in 0.434s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.159s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-quobyte-35ab5910-8bdd-41b0-b5da-58b62406a42c-6542e263-7bce-4429-8f28-375a9ee44028" by "_create_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a20837b-b8c1-4f9d-9e12-d3e76cfbbbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d44293b-610c-4767-9c8b-e9c61f119fab', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83afd288-a633-412b-b1ab-dacd859b7017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-35ab5910-8bdd-41b0-b5da-58b62406a42c-6542e263-7bce-4429-8f28-375a9ee44028" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Creating volume 6542e263-7bce-4429-8f28-375a9ee44028 from snapshot 35ab5910-8bdd-41b0-b5da-58b62406a42c {{(pid=82139) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-quobyte-6542e263-7bce-4429-8f28-375a9ee44028" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:43 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Volume volume-0d44293b-610c-4767-9c8b-e9c61f119fab (0d44293b-610c-4767-9c8b-e9c61f119fab): created successfully Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83afd288-a633-412b-b1ab-dacd859b7017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (54eaa2c0-521c-44ed-a8c9-a1e9255143f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-6542e263-7bce-4429-8f28-375a9ee44028" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] snapshot: 35ab5910-8bdd-41b0-b5da-58b62406a42c, volume: 6542e263-7bce-4429-8f28-375a9ee44028, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:58:43 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2736807f-9ee2-4af8-8d64-59993d2a833c tempest-VolumesSnapshotTestJSON-814736045 None] Created volume successfully. Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd950aaf-36f3-4cc7-bbbb-77451e393b0b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:43 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c Apr 09 16:58:43 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:44 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c" returned: 0 in 0.479s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da15892b-7ba3-445e-b01c-8f186a037ef5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d61af7-19dd-4806-b002-a360dc4a3551]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:44 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 Apr 09 16:58:44 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:44 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5" returned: 0 in 0.499s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:58:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:44 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 Apr 09 16:58:44 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:46 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028" returned: 0 in 1.937s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[81796e39-04b1-40dd-a0e2-af5ea2aacf56]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:46 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 Apr 09 16:58:46 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:47 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5" returned: 0 in 0.595s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:58:47 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Converted 1024.00 MB image at 528.28 MB/s Apr 09 16:58:47 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 is being set with open permissions: ugo+rw Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:47 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 Apr 09 16:58:47 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:47 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028" returned: 0 in 0.420s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-6542e263-7bce-4429-8f28-375a9ee44028" released by "_copy_volume_from_snapshot" :: held 3.998s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-35ab5910-8bdd-41b0-b5da-58b62406a42c-6542e263-7bce-4429-8f28-375a9ee44028" released by "_create_volume_from_snapshot" :: held 4.022s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.040s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.272s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Creating offline snapshot a3d271e6-969b-4601-aa6f-ccbe0036384d of volume 0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1831510a-6208-473e-9b75-af762c425de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6542e263-7bce-4429-8f28-375a9ee44028', 'volume_size': 1, 'snapshot_id': '35ab5910-8bdd-41b0-b5da-58b62406a42c'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9491934c-0760-4287-8471-d1088a4424ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f18e5-067b-4701-8a2a-2cf50616350d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:47 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Volume volume-6542e263-7bce-4429-8f28-375a9ee44028 (6542e263-7bce-4429-8f28-375a9ee44028): created successfully Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9491934c-0760-4287-8471-d1088a4424ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Flow 'volume_create_manager' (f3cd39ba-1fc4-41ea-90cb-67df23db202c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:47 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a5631459-d90f-4c54-96cb-1b1ae765e1fc tempest-SnapshotDependencyTests-946741140 None] Created volume successfully. Apr 09 16:58:48 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab Apr 09 16:58:48 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:48 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:48 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d 1G Apr 09 16:58:48 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:48 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d 1G" returned: 0 in 0.506s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d44293b-610c-4767-9c8b-e9c61f119fab -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:48 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d44293b-610c-4767-9c8b-e9c61f119fab -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d Apr 09 16:58:48 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-35ab5910-8bdd-41b0-b5da-58b62406a42c-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-35ab5910-8bdd-41b0-b5da-58b62406a42c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-quobyte-da15892b-7ba3-445e-b01c-8f186a037ef5" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-da15892b-7ba3-445e-b01c-8f186a037ef5" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-quobyte-35ab5910-8bdd-41b0-b5da-58b62406a42c" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-35ab5910-8bdd-41b0-b5da-58b62406a42c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Deleting offline snapshot 35ab5910-8bdd-41b0-b5da-58b62406a42c of volume da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] snapshot_file for this snap is: volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555334b-63f2-4d3c-b890-7c910ac80abd]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:49 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c Apr 09 16:58:49 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:49 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d44293b-610c-4767-9c8b-e9c61f119fab -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d" returned: 0 in 0.464s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:49 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d is being set with open permissions: ugo+rw Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:49 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d Apr 09 16:58:49 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:49 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c" returned: 0 in 0.484s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da15892b-7ba3-445e-b01c-8f186a037ef5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1ccf4e-2eaa-480f-a1d0-03939197576d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:49 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 Apr 09 16:58:49 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:49 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d" returned: 0 in 0.412s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:49 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.info Apr 09 16:58:49 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:50 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5" returned: 0 in 0.507s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:50 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c Apr 09 16:58:50 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:50 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.info" returned: 0 in 0.431s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:50 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.info is being set with open permissions: ugo+rw Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:50 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.info Apr 09 16:58:50 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:50 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c" returned: 0 in 0.471s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:50 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c Apr 09 16:58:50 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:50 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.info" returned: 0 in 0.417s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.779s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:50 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e47769e9-6550-4f7d-ba0a-cbc67e578a21 tempest-VolumesSnapshotTestJSON-814736045 None] Create snapshot completed successfully Apr 09 16:58:50 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5.35ab5910-8bdd-41b0-b5da-58b62406a42c" returned: 0 in 0.452s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-35ab5910-8bdd-41b0-b5da-58b62406a42c" released by "_delete_snapshot" :: held 1.964s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-da15892b-7ba3-445e-b01c-8f186a037ef5" released by "delete_snapshot" :: held 1.978s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Created reservations ['81457228-1b99-48d4-a3e5-3fe2ca3ef34b', '9df69492-1668-457e-9b45-cc6ae7fbe49a', '0a038268-83b2-4372-8a3e-4fae216f8c25', '4840959b-e575-4ff3-bac9-6ca5cfb4ac6c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (dc8cf168-eb39-4e10-9d70-208c37b96cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398ddc4b-0a20-438d-893a-4c1ea981a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398ddc4b-0a20-438d-893a-4c1ea981a12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-454068925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecbb762-20c9-4c2e-930b-cf9ca5523b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8a6aeebece4809b43d3af1df387912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:58:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a3d271e6-969b-4601-aa6f-ccbe0036384d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:58:51Z,use_quota=True,user_id='94af5ada48ce4f21b19f6900dfe24526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955f4d8d-4377-43a2-83de-a735d8172e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955f4d8d-4377-43a2-83de-a735d8172e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead8fbee-6634-4fc2-bbb9-ba5c8957bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead8fbee-6634-4fc2-bbb9-ba5c8957bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aecbb762-20c9-4c2e-930b-cf9ca5523b6a', 'volume_name': 'volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a', 'volume_size': 2, 'snapshot_id': 'a3d271e6-969b-4601-aa6f-ccbe0036384d'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f2d34d-9b37-4b65-9368-3281e9d33df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f2d34d-9b37-4b65-9368-3281e9d33df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129d7684-ed8f-4e7b-9064-2af5055c9109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:51 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Volume aecbb762-20c9-4c2e-930b-cf9ca5523b6a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a', 'volume_size': 2, 'snapshot_id': 'a3d271e6-969b-4601-aa6f-ccbe0036384d'} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-a3d271e6-969b-4601-aa6f-ccbe0036384d-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" by "_create_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-a3d271e6-969b-4601-aa6f-ccbe0036384d-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Creating volume aecbb762-20c9-4c2e-930b-cf9ca5523b6a from snapshot a3d271e6-969b-4601-aa6f-ccbe0036384d {{(pid=82139) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] snapshot: a3d271e6-969b-4601-aa6f-ccbe0036384d, volume: aecbb762-20c9-4c2e-930b-cf9ca5523b6a, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:58:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Delete snapshot completed successfully. Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-50bce57a-6274-4314-b080-faf13305cf50 tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-35ab5910-8bdd-41b0-b5da-58b62406a42c-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a4a914-140a-4dc3-a0aa-4b9b82a7fbfe]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:51 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d Apr 09 16:58:51 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:51 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d" returned: 0 in 0.478s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d44293b-610c-4767-9c8b-e9c61f119fab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d78bb1-6e75-4af9-87f0-d94dd1117352]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:51 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab Apr 09 16:58:51 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-da15892b-7ba3-445e-b01c-8f186a037ef5-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-da15892b-7ba3-445e-b01c-8f186a037ef5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-quobyte-da15892b-7ba3-445e-b01c-8f186a037ef5" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:52 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-da15892b-7ba3-445e-b01c-8f186a037ef5" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab" returned: 0 in 0.519s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[108aa974-ac43-4bbc-9407-f121ba15c999]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:52 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a Apr 09 16:58:52 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:52 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 Apr 09 16:58:52 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:52 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5" returned: 0 in 0.721s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:53 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5 Apr 09 16:58:53 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:53 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-da15892b-7ba3-445e-b01c-8f186a037ef5" returned: 0 in 0.906s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-da15892b-7ba3-445e-b01c-8f186a037ef5" released by "delete_volume" :: held 1.679s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:53 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Created reservations ['8297cf8c-cd79-4deb-aa8e-002016c22152', 'd51080de-330d-424b-8502-ff56d2ee3453', 'f2425433-66fe-4838-8b4c-7b5c0d50e816', '44e59d1e-aeeb-4695-942f-8e31ceb63c9a'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:54 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:58:54 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-6542e263-7bce-4429-8f28-375a9ee44028-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-6542e263-7bce-4429-8f28-375a9ee44028-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:54 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" returned: 0 in 2.179s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a88185-121f-4103-8498-29dbfc1aa4ce]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "cinder-quobyte-6542e263-7bce-4429-8f28-375a9ee44028" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-6542e263-7bce-4429-8f28-375a9ee44028" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b4199e-0998-4a1c-9959-c5652386c743]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:54 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab Apr 09 16:58:54 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:54 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 Apr 09 16:58:54 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:54 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.566s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:58:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Deleted volume successfully. Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e9fa1b64-eac5-43be-bb6c-92e634de5a6f tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-da15892b-7ba3-445e-b01c-8f186a037ef5-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:54 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:54 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028 Apr 09 16:58:54 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:55 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab" returned: 0 in 0.642s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:58:55 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Converted 1024.00 MB image at 469.66 MB/s Apr 09 16:58:55 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a is being set with open permissions: ugo+rw Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:55 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a Apr 09 16:58:55 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:55 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6542e263-7bce-4429-8f28-375a9ee44028" returned: 0 in 0.442s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-quobyte-6542e263-7bce-4429-8f28-375a9ee44028" released by "delete_volume" :: held 0.934s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Created reservations ['ef682fa9-fff1-4055-a747-80c076d41265', '27692bb9-a486-4d52-8468-25d8df8e8337', 'ac403ba3-c32e-40da-a33a-09a6e011e47c', '6de1b784-dd71-4a1d-aa9f-8a47dc59c636'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:55 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:58:55 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:55 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" returned: 0 in 0.442s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" released by "_copy_volume_from_snapshot" :: held 4.320s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-a3d271e6-969b-4601-aa6f-ccbe0036384d-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" released by "_create_volume_from_snapshot" :: held 4.341s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.354s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129d7684-ed8f-4e7b-9064-2af5055c9109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a', 'volume_size': 2, 'snapshot_id': 'a3d271e6-969b-4601-aa6f-ccbe0036384d'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d6ba71-c6af-400b-91a8-13637f677574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:58:55 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Volume volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a (aecbb762-20c9-4c2e-930b-cf9ca5523b6a): created successfully Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d6ba71-c6af-400b-91a8-13637f677574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (dc8cf168-eb39-4e10-9d70-208c37b96cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:58:55 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4fada513-29f6-4d8d-a5a0-cc8744a896c1 tempest-VolumesSnapshotTestJSON-814736045 None] Created volume successfully. Apr 09 16:58:55 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:58:55 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Deleted volume successfully. Apr 09 16:58:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35a6d0b3-03e6-4b43-87f2-61aed48d526a tempest-SnapshotDependencyTests-946741140 None] Lock "cinder-6542e263-7bce-4429-8f28-375a9ee44028-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-aecbb762-20c9-4c2e-930b-cf9ca5523b6a-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-aecbb762-20c9-4c2e-930b-cf9ca5523b6a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:56 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ef8daf-9ddb-4cd5-97b1-a085e372247b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:56 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a Apr 09 16:58:56 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:57 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" returned: 0 in 0.531s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:57 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a Apr 09 16:58:57 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:57 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-aecbb762-20c9-4c2e-930b-cf9ca5523b6a" released by "delete_volume" :: held 1.049s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Created reservations ['7f077ef5-00f5-4741-b1f2-080a9552917b', 'eaee8408-f438-46f1-aecb-5ca38ee93490', '14ae3b0f-96ad-4467-b330-83c31103e12c', '081769c5-d724-4667-a5a6-0f82183a4fdb'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:58:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:57 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:58:57 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:58 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.530s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:58:58 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Deleted volume successfully. Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-7af538e3-9b9a-4dc9-a8ac-53efc550bfbc tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-aecbb762-20c9-4c2e-930b-cf9ca5523b6a-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-a3d271e6-969b-4601-aa6f-ccbe0036384d-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-a3d271e6-969b-4601-aa6f-ccbe0036384d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-0d44293b-610c-4767-9c8b-e9c61f119fab" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-0d44293b-610c-4767-9c8b-e9c61f119fab" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-a3d271e6-969b-4601-aa6f-ccbe0036384d" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-a3d271e6-969b-4601-aa6f-ccbe0036384d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Deleting offline snapshot a3d271e6-969b-4601-aa6f-ccbe0036384d of volume 0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] snapshot_file for this snap is: volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ae1cf6-b10c-496c-8719-b5c556b15bfa]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:58 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d Apr 09 16:58:58 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:59 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d" returned: 0 in 0.515s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d44293b-610c-4767-9c8b-e9c61f119fab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:58:59 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbced77-4e63-4a9d-b8c1-2164e8179272]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:58:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:59 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab Apr 09 16:58:59 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:58:59 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 09 16:58:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab" returned: 0 in 0.534s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:58:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:58:59 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d Apr 09 16:58:59 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:00 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d" returned: 0 in 0.519s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:00 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d Apr 09 16:59:00 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:00 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab.a3d271e6-969b-4601-aa6f-ccbe0036384d" returned: 0 in 0.473s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-a3d271e6-969b-4601-aa6f-ccbe0036384d" released by "_delete_snapshot" :: held 2.100s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-0d44293b-610c-4767-9c8b-e9c61f119fab" released by "delete_snapshot" :: held 2.119s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:00 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Created reservations ['9d8faa04-3000-4694-bd19-3c9d0cc87a12', '03e4fdb8-f884-4de8-98c0-4b0a875750c6', '436b2786-959a-49b3-a202-db746a36b3aa', '4d25a0a2-dc13-4fe7-b61d-caab2540efc0'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:00 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Delete snapshot completed successfully. Apr 09 16:59:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8ac01025-b7ac-448e-99c6-734b54047092 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-a3d271e6-969b-4601-aa6f-ccbe0036384d-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-0d44293b-610c-4767-9c8b-e9c61f119fab-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-0d44293b-610c-4767-9c8b-e9c61f119fab-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-0d44293b-610c-4767-9c8b-e9c61f119fab" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-0d44293b-610c-4767-9c8b-e9c61f119fab" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:01 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[737b0493-f090-48d6-a9c4-40971bcd966a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:02 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab Apr 09 16:59:02 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:02 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab" returned: 0 in 0.491s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:02 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab Apr 09 16:59:02 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:02 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0d44293b-610c-4767-9c8b-e9c61f119fab" returned: 0 in 0.415s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-0d44293b-610c-4767-9c8b-e9c61f119fab" released by "delete_volume" :: held 0.950s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Created reservations ['e6d1bf88-4ef8-42b9-b7fe-33183206ab5f', '4f6c4646-d2f5-4a52-9e83-e3ad9af12fa6', 'a0ed4cc0-332d-47e6-8095-b2d1b7d001b0', '18b35cbf-8174-4d58-8ccc-c8b42b67b63c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:03 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:03 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (2a099f1d-06b9-41af-8650-12f620b3d144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31159245-77a8-4d9c-9603-06e4f5fd5c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31159245-77a8-4d9c-9603-06e4f5fd5c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-188930054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29370d3-e7af-45a5-a24e-9f6d0711b12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8a6aeebece4809b43d3af1df387912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:03Z,use_quota=True,user_id='94af5ada48ce4f21b19f6900dfe24526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ef68fe-919f-4bc1-b0b0-b08e98982e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ef68fe-919f-4bc1-b0b0-b08e98982e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d7a733-a561-4a9c-8eda-d7aaf1a26ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d7a733-a561-4a9c-8eda-d7aaf1a26ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29370d3-e7af-45a5-a24e-9f6d0711b12f', 'volume_name': 'volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da40e0ed-e188-4e76-b6f2-3b1b9659076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da40e0ed-e188-4e76-b6f2-3b1b9659076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d176d3-3229-4b8c-9a14-2449aa94e390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:03 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Volume f29370d3-e7af-45a5-a24e-9f6d0711b12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f', 'volume_size': 1} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-188930054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29370d3-e7af-45a5-a24e-9f6d0711b12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8a6aeebece4809b43d3af1df387912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:03Z,use_quota=True,user_id='94af5ada48ce4f21b19f6900dfe24526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Creating volume f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:03 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:03 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f 1073741824 Apr 09 16:59:03 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:03 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.447s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Deleted volume successfully. Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-fc497a95-8766-4f90-9b60-73474f9e0051 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-0d44293b-610c-4767-9c8b-e9c61f119fab-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:03 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f 1073741824" returned: 0 in 0.499s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:03 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f Apr 09 16:59:03 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:04 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f" returned: 0 in 0.418s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d176d3-3229-4b8c-9a14-2449aa94e390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d642b0-0537-449f-97c8-a4bea48b0a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:04 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Volume volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f (f29370d3-e7af-45a5-a24e-9f6d0711b12f): created successfully Apr 09 16:59:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d642b0-0537-449f-97c8-a4bea48b0a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:04 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (2a099f1d-06b9-41af-8650-12f620b3d144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:04 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f718858c-5822-4a05-8acc-97180648d7fd tempest-VolumesSnapshotTestJSON-814736045 None] Created volume successfully. Apr 09 16:59:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Creating offline snapshot 0062eb4b-6326-4b25-8bac-772467314c36 of volume f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:59:05 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[62909909-3909-4a1f-bfb8-d28441722eae]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:05 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f Apr 09 16:59:05 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:05 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f" returned: 0 in 0.463s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:05 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 1G Apr 09 16:59:05 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:06 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 1G" returned: 0 in 0.466s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:06 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 Apr 09 16:59:06 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:06 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36" returned: 0 in 0.429s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:06 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 is being set with open permissions: ugo+rw Apr 09 16:59:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:06 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 Apr 09 16:59:06 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:07 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36" returned: 0 in 0.416s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:07 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.info Apr 09 16:59:07 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:07 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.info" returned: 0 in 0.406s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:07 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.info is being set with open permissions: ugo+rw Apr 09 16:59:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:07 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.info Apr 09 16:59:07 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:08 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.info" returned: 0 in 0.406s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:08 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-11c3d174-e9ab-4deb-ad20-7e7390f95b03 tempest-VolumesSnapshotTestJSON-814736045 None] Create snapshot completed successfully Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (74df8f02-97bb-4cbe-ba76-10e060f4b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d804a4d0-b6cd-4006-bfd6-a6f88c5200e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d804a4d0-b6cd-4006-bfd6-a6f88c5200e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-568260726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef06bf9-67fb-4aed-8d2f-0e025112e851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8a6aeebece4809b43d3af1df387912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0062eb4b-6326-4b25-8bac-772467314c36,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:09Z,use_quota=True,user_id='94af5ada48ce4f21b19f6900dfe24526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242c98ca-0ab1-443f-8768-e1eaa6721af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242c98ca-0ab1-443f-8768-e1eaa6721af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2ac1f9-f09a-470f-9295-bb273785e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2ac1f9-f09a-470f-9295-bb273785e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bef06bf9-67fb-4aed-8d2f-0e025112e851', 'volume_name': 'volume-bef06bf9-67fb-4aed-8d2f-0e025112e851', 'volume_size': 1, 'snapshot_id': '0062eb4b-6326-4b25-8bac-772467314c36'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97683730-8ee8-4295-bc82-ee3f15cfaf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97683730-8ee8-4295-bc82-ee3f15cfaf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66fcbc0-81e4-40e7-a6ea-dbb2363bfcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:08 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Volume bef06bf9-67fb-4aed-8d2f-0e025112e851: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bef06bf9-67fb-4aed-8d2f-0e025112e851', 'volume_size': 1, 'snapshot_id': '0062eb4b-6326-4b25-8bac-772467314c36'} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-0062eb4b-6326-4b25-8bac-772467314c36-bef06bf9-67fb-4aed-8d2f-0e025112e851" by "_create_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-0062eb4b-6326-4b25-8bac-772467314c36-bef06bf9-67fb-4aed-8d2f-0e025112e851" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Creating volume bef06bf9-67fb-4aed-8d2f-0e025112e851 from snapshot 0062eb4b-6326-4b25-8bac-772467314c36 {{(pid=82139) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-bef06bf9-67fb-4aed-8d2f-0e025112e851" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-bef06bf9-67fb-4aed-8d2f-0e025112e851" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] snapshot: 0062eb4b-6326-4b25-8bac-772467314c36, volume: bef06bf9-67fb-4aed-8d2f-0e025112e851, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc64bad-16fd-4e08-9465-73bf699be004]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:09 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 Apr 09 16:59:09 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:09 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36" returned: 0 in 0.460s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3b62a1-cfcc-4d41-b895-42e1bf747c11]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:09 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f Apr 09 16:59:09 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:09 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f" returned: 0 in 0.473s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:59:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:09 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 Apr 09 16:59:09 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:11 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851" returned: 0 in 1.976s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:11 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31a6720-511b-4c80-8dee-12ec5db1d1c7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:11 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f Apr 09 16:59:11 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:12 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f" returned: 0 in 0.602s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:59:12 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Converted 1024.00 MB image at 517.80 MB/s Apr 09 16:59:12 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 is being set with open permissions: ugo+rw Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:12 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 Apr 09 16:59:12 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:12 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851" returned: 0 in 0.405s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-bef06bf9-67fb-4aed-8d2f-0e025112e851" released by "_copy_volume_from_snapshot" :: held 3.976s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-0062eb4b-6326-4b25-8bac-772467314c36-bef06bf9-67fb-4aed-8d2f-0e025112e851" released by "_create_volume_from_snapshot" :: held 3.992s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66fcbc0-81e4-40e7-a6ea-dbb2363bfcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef06bf9-67fb-4aed-8d2f-0e025112e851', 'volume_size': 1, 'snapshot_id': '0062eb4b-6326-4b25-8bac-772467314c36'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0e90e6-57f0-418b-89fe-5f9e3511377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Volume volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 (bef06bf9-67fb-4aed-8d2f-0e025112e851): created successfully Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0e90e6-57f0-418b-89fe-5f9e3511377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Flow 'volume_create_manager' (74df8f02-97bb-4cbe-ba76-10e060f4b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:12 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3d6a5d06-7cbc-45dc-80cc-b6d2986fba16 tempest-VolumesSnapshotTestJSON-814736045 None] Created volume successfully. Apr 09 16:59:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-bef06bf9-67fb-4aed-8d2f-0e025112e851-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-bef06bf9-67fb-4aed-8d2f-0e025112e851-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-bef06bf9-67fb-4aed-8d2f-0e025112e851" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-bef06bf9-67fb-4aed-8d2f-0e025112e851" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:13 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea62ecc-d303-4f62-b2e1-5225e6d47b20]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:13 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 Apr 09 16:59:13 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:13 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851" returned: 0 in 0.465s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:13 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851 Apr 09 16:59:13 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:14 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bef06bf9-67fb-4aed-8d2f-0e025112e851" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-bef06bf9-67fb-4aed-8d2f-0e025112e851" released by "delete_volume" :: held 0.913s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:14 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:14 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Created reservations ['a52b87d8-4778-41a8-ad9d-1e9a58ebc9cb', '21c3d7e3-2d7d-4bd0-aef1-ca565cfb8051', '9c60de51-e678-4fe4-a254-0d3c2c57c00a', 'a3e2e541-22b2-4e1b-9506-7497204367cd'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:14 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:14 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-0062eb4b-6326-4b25-8bac-772467314c36-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-0062eb4b-6326-4b25-8bac-772467314c36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-f29370d3-e7af-45a5-a24e-9f6d0711b12f" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-f29370d3-e7af-45a5-a24e-9f6d0711b12f" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-0062eb4b-6326-4b25-8bac-772467314c36" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-0062eb4b-6326-4b25-8bac-772467314c36" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Deleting offline snapshot 0062eb4b-6326-4b25-8bac-772467314c36 of volume f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] snapshot_file for this snap is: volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f340e8d-9378-4201-8250-9826a9303a1d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:14 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 Apr 09 16:59:14 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:14 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.444s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:14 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.441s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Deleted volume successfully. Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-019fac01-62eb-439a-a459-006b9915d94c tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-bef06bf9-67fb-4aed-8d2f-0e025112e851-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:14 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36" returned: 0 in 0.481s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b054c0d4-e61c-435b-8cf2-77458ff4d3b8]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:14 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f Apr 09 16:59:14 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:15 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f" returned: 0 in 0.466s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:15 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 Apr 09 16:59:15 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:15 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36" returned: 0 in 0.440s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:15 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36 Apr 09 16:59:15 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:16 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f.0062eb4b-6326-4b25-8bac-772467314c36" returned: 0 in 0.405s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-0062eb4b-6326-4b25-8bac-772467314c36" released by "_delete_snapshot" :: held 1.849s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-f29370d3-e7af-45a5-a24e-9f6d0711b12f" released by "delete_snapshot" :: held 1.858s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Created reservations ['f71e878c-629f-4ca8-ab1b-c89b89134c17', '13d6d194-b98d-4b37-9333-d64609220502', 'd6fc2df7-2302-4b5c-abd2-5ab92a6f7d3f', '902a8c58-5f5e-48b1-b24b-0495b2a7aff6'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Delete snapshot completed successfully. Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a181e095-8d0f-4481-ae3e-f88cf0b935dd tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-0062eb4b-6326-4b25-8bac-772467314c36-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-f29370d3-e7af-45a5-a24e-9f6d0711b12f-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-f29370d3-e7af-45a5-a24e-9f6d0711b12f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-f29370d3-e7af-45a5-a24e-9f6d0711b12f" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-f29370d3-e7af-45a5-a24e-9f6d0711b12f" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac2b0e5-4e32-4b53-a292-b94c89dc81ad]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:16 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f Apr 09 16:59:16 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:16 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:16 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f Apr 09 16:59:16 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:17 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-f29370d3-e7af-45a5-a24e-9f6d0711b12f" returned: 0 in 0.410s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-f29370d3-e7af-45a5-a24e-9f6d0711b12f" released by "delete_volume" :: held 0.911s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Created reservations ['e3e0d878-4942-4316-944b-a042367a1539', 'c42fdc37-6adb-4f01-89c3-3dccf0b91be5', '1078eaa9-d4d4-45c9-ae74-6c332b48e69d', '6cd66161-effd-44ef-930a-a67abdbb76f6'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:17 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:17 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "cinder-quobyte-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fec98b-632f-495b-8f91-a24bf917c10d]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:17 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 Apr 09 16:59:17 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:17 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.426s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:17 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Deleted volume successfully. Apr 09 16:59:17 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-91a0ed77-f9ec-4619-a207-e8df54b0a4ed tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-f29370d3-e7af-45a5-a24e-9f6d0711b12f-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:18 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" returned: 0 in 0.479s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:18 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280 Apr 09 16:59:18 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:18 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" returned: 0 in 0.408s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-quobyte-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280" released by "delete_volume" :: held 0.920s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Created reservations ['0a5293cf-732f-4cc6-b9ba-67d4161832f8', '9acc7bee-8563-4cfe-ae1a-f070fc645443', '19cf6114-6630-4dcb-aea8-db2cee22592f', '53619838-8885-47e9-91b4-0b3f1d63bb14'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:18 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:18 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:19 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:19 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:19 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Deleted volume successfully. Apr 09 16:59:19 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=119,cinder:UPDATE=126,cinder:INSERT=33,cinder:DELETE=10 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:59:19 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-cc2128bb-d209-42a7-923a-7ee472ef6ee0 tempest-VolumesSnapshotTestJSON-814736045 None] Lock "cinder-1d20debb-7ebf-4c2e-b7c8-1a3c27eea280-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=119,cinder:SELECT=91,cinder:INSERT=27,cinder:DELETE=10 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (6c09271c-6ec6-4cd6-a604-ac28a1733956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3054c4-c2b8-47f2-b781-c9dc86d282ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3054c4-c2b8-47f2-b781-c9dc86d282ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691212569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7b7246-eb70-403d-8214-66db20412639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:22Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e460c8f2-16c3-43c2-bff1-0e9c5a473871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e460c8f2-16c3-43c2-bff1-0e9c5a473871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14b51a1-a1cc-40b6-b782-74bd79288cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14b51a1-a1cc-40b6-b782-74bd79288cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f7b7246-eb70-403d-8214-66db20412639', 'volume_name': 'volume-0f7b7246-eb70-403d-8214-66db20412639', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194046cd-9fca-4439-a27a-598dd3568c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194046cd-9fca-4439-a27a-598dd3568c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8619102-3581-4a14-b45c-779941e5f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:22 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume 0f7b7246-eb70-403d-8214-66db20412639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f7b7246-eb70-403d-8214-66db20412639', 'volume_size': 1} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691212569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7b7246-eb70-403d-8214-66db20412639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:22Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Creating volume 0f7b7246-eb70-403d-8214-66db20412639 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:22 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:22 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 1073741824 Apr 09 16:59:22 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:22 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 1073741824" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:22 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 Apr 09 16:59:22 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:23 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639" returned: 0 in 0.416s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8619102-3581-4a14-b45c-779941e5f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7b7246-eb70-403d-8214-66db20412639', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9193e63-545d-4fc7-8d56-830cd32fa3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:23 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume volume-0f7b7246-eb70-403d-8214-66db20412639 (0f7b7246-eb70-403d-8214-66db20412639): created successfully Apr 09 16:59:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9193e63-545d-4fc7-8d56-830cd32fa3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:23 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (6c09271c-6ec6-4cd6-a604-ac28a1733956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:23 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7d6cad93-8f09-42a4-b760-a44d5579c887 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created volume successfully. Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (748176da-affb-4169-8db4-fa44c8bb56e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb36985a-8f01-4730-95f3-0debe7a8e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb36985a-8f01-4730-95f3-0debe7a8e017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538366059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b060428-c483-4d49-97ad-33e6f011bc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9589775-8cd6-4769-8a89-95b3a13dfc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9589775-8cd6-4769-8a89-95b3a13dfc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b1f23b-f54a-4e30-9c37-80664abd4a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b1f23b-f54a-4e30-9c37-80664abd4a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b060428-c483-4d49-97ad-33e6f011bc4a', 'volume_name': 'volume-6b060428-c483-4d49-97ad-33e6f011bc4a', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054edd3e-d08b-4193-9717-69b60fb1515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054edd3e-d08b-4193-9717-69b60fb1515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2be8e4-a00c-48a2-8d1e-928cb170be31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume 6b060428-c483-4d49-97ad-33e6f011bc4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b060428-c483-4d49-97ad-33e6f011bc4a', 'volume_size': 1} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538366059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b060428-c483-4d49-97ad-33e6f011bc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Creating volume 6b060428-c483-4d49-97ad-33e6f011bc4a {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:24 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:24 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a 1073741824 Apr 09 16:59:24 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (c2c7540d-02a1-4300-b26f-176b2514333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c66c702-5d7a-4ef8-b870-0af4dbecba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c66c702-5d7a-4ef8-b870-0af4dbecba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365333243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb26407-7a30-4cd4-872e-80ed8afb2a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2a34c2-38a5-496c-ae19-47e4496b237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2a34c2-38a5-496c-ae19-47e4496b237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a3a86c-54dc-49b9-9c8b-27eb374594f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a3a86c-54dc-49b9-9c8b-27eb374594f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb26407-7a30-4cd4-872e-80ed8afb2a0c', 'volume_name': 'volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e21bef-e35d-4473-b686-2890a37f7184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e21bef-e35d-4473-b686-2890a37f7184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afaf6483-2955-40ec-83d5-0f97ac8732e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:24 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume 0cb26407-7a30-4cd4-872e-80ed8afb2a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c', 'volume_size': 1} Apr 09 16:59:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (dc6da524-e98a-4a07-a56f-6ceb81bb4453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b1d469-100a-4656-bdb1-dc9a82dd9c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b1d469-100a-4656-bdb1-dc9a82dd9c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117485463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8411b1b5-cb59-4823-8b6a-a74b7b38bf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42a3822-726a-43e1-8bf3-056cf67c4551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42a3822-726a-43e1-8bf3-056cf67c4551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e8d224-7f7a-47d0-9e63-1541cab6ae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e8d224-7f7a-47d0-9e63-1541cab6ae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8411b1b5-cb59-4823-8b6a-a74b7b38bf81', 'volume_name': 'volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecd9c8b-3f3d-4f13-b6a9-ca1d545fa2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecd9c8b-3f3d-4f13-b6a9-ca1d545fa2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80692095-1091-4c33-8d53-e5a71503505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume 8411b1b5-cb59-4823-8b6a-a74b7b38bf81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81', 'volume_size': 1} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (bae36bd0-adca-41b3-913e-bf2e0009d952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9a8732-7808-4084-97c3-2d87fb1c7c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9a8732-7808-4084-97c3-2d87fb1c7c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864513222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb281d07-d367-425f-b1af-85da39c6821b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bce8237-df85-452d-9a81-0880c8cd2833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bce8237-df85-452d-9a81-0880c8cd2833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5e5bdd-b3ef-4114-ae7b-2b3d7d75604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5e5bdd-b3ef-4114-ae7b-2b3d7d75604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb281d07-d367-425f-b1af-85da39c6821b', 'volume_name': 'volume-eb281d07-d367-425f-b1af-85da39c6821b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5362c1-a110-4f39-8494-02174a44b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5362c1-a110-4f39-8494-02174a44b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9029f7fe-2b97-4fcd-b76c-5ad2d9164b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume eb281d07-d367-425f-b1af-85da39c6821b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb281d07-d367-425f-b1af-85da39c6821b', 'volume_size': 1} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:25 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a 1073741824" returned: 0 in 0.570s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:25 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a Apr 09 16:59:25 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (02c9911a-79d4-4f99-9b40-5c3a6e2a5c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb625f58-fe79-44c4-8894-9c3dc78680aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb625f58-fe79-44c4-8894-9c3dc78680aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586845682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62e072b-e976-4b3d-a921-4648c282a160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1237c4ff-86cf-464f-862f-d47031e0a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1237c4ff-86cf-464f-862f-d47031e0a562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9234e193-4d32-483d-a07a-686796e46337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9234e193-4d32-483d-a07a-686796e46337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e62e072b-e976-4b3d-a921-4648c282a160', 'volume_name': 'volume-e62e072b-e976-4b3d-a921-4648c282a160', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4395cf0-2872-499b-a9e3-82f121ef46a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4395cf0-2872-499b-a9e3-82f121ef46a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831e7b93-2221-4cec-8872-a84063f4e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume e62e072b-e976-4b3d-a921-4648c282a160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e62e072b-e976-4b3d-a921-4648c282a160', 'volume_size': 1} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:25 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a" returned: 0 in 0.419s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365333243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb26407-7a30-4cd4-872e-80ed8afb2a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Creating volume 0cb26407-7a30-4cd4-872e-80ed8afb2a0c {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:25 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2be8e4-a00c-48a2-8d1e-928cb170be31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b060428-c483-4d49-97ad-33e6f011bc4a', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c 1073741824 Apr 09 16:59:25 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4490570-fff5-41f0-a311-b83954264159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume volume-6b060428-c483-4d49-97ad-33e6f011bc4a (6b060428-c483-4d49-97ad-33e6f011bc4a): created successfully Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4490570-fff5-41f0-a311-b83954264159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (748176da-affb-4169-8db4-fa44c8bb56e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:25 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8d4bfe75-66b3-4c09-a266-103bfb033d7d tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created volume successfully. Apr 09 16:59:26 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c 1073741824" returned: 0 in 0.511s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:26 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c Apr 09 16:59:26 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:26 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c" returned: 0 in 0.426s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117485463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8411b1b5-cb59-4823-8b6a-a74b7b38bf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Creating volume 8411b1b5-cb59-4823-8b6a-a74b7b38bf81 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:26 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afaf6483-2955-40ec-83d5-0f97ac8732e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:26 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 1073741824 Apr 09 16:59:26 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e603ddc5-4894-49c7-9d66-02b5e2262932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:26 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c (0cb26407-7a30-4cd4-872e-80ed8afb2a0c): created successfully Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e603ddc5-4894-49c7-9d66-02b5e2262932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:26 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (c2c7540d-02a1-4300-b26f-176b2514333f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:26 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-68573267-43cb-41e5-85e9-7b51b941b924 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created volume successfully. Apr 09 16:59:27 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 1073741824" returned: 0 in 0.477s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:27 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 Apr 09 16:59:27 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:27 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81" returned: 0 in 0.415s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.345s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864513222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb281d07-d367-425f-b1af-85da39c6821b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Creating volume eb281d07-d367-425f-b1af-85da39c6821b {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:27 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80692095-1091-4c33-8d53-e5a71503505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:27 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b 1073741824 Apr 09 16:59:27 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667a4396-85a5-4393-8e12-5222ea316ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:27 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 (8411b1b5-cb59-4823-8b6a-a74b7b38bf81): created successfully Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667a4396-85a5-4393-8e12-5222ea316ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (dc6da524-e98a-4a07-a56f-6ceb81bb4453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-5b329955-97e6-4374-b120-3a879f0259dc tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created volume successfully. Apr 09 16:59:28 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b 1073741824" returned: 0 in 0.485s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:28 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b Apr 09 16:59:28 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:28 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b" returned: 0 in 0.404s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.065s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586845682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62e072b-e976-4b3d-a921-4648c282a160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c513d4385702401b81fb09154dd68eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:25Z,use_quota=True,user_id='6a465039f8ca4bd5a07d37370d629033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Creating volume e62e072b-e976-4b3d-a921-4648c282a160 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:28 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9029f7fe-2b97-4fcd-b76c-5ad2d9164b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb281d07-d367-425f-b1af-85da39c6821b', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe42b98-4e9e-4d7f-92af-242db53e1af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:28 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 1073741824 Apr 09 16:59:28 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:28 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume volume-eb281d07-d367-425f-b1af-85da39c6821b (eb281d07-d367-425f-b1af-85da39c6821b): created successfully Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe42b98-4e9e-4d7f-92af-242db53e1af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (bae36bd0-adca-41b3-913e-bf2e0009d952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3043ba09-da0c-496e-b994-646785a06a94 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created volume successfully. Apr 09 16:59:28 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 1073741824" returned: 0 in 0.494s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:29 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 Apr 09 16:59:29 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:29 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160" returned: 0 in 0.409s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831e7b93-2221-4cec-8872-a84063f4e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62e072b-e976-4b3d-a921-4648c282a160', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258b31e6-1c55-4919-ac9f-5a32d1db8666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:29 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Volume volume-e62e072b-e976-4b3d-a921-4648c282a160 (e62e072b-e976-4b3d-a921-4648c282a160): created successfully Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258b31e6-1c55-4919-ac9f-5a32d1db8666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Flow 'volume_create_manager' (02c9911a-79d4-4f99-9b40-5c3a6e2a5c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-5f59db83-4beb-4563-8a7e-9896598e3da9 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created volume successfully. Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-e62e072b-e976-4b3d-a921-4648c282a160-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-e62e072b-e976-4b3d-a921-4648c282a160-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-quobyte-e62e072b-e976-4b3d-a921-4648c282a160" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-e62e072b-e976-4b3d-a921-4648c282a160" acquired by "delete_volume" :: waited 0.016s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a763f-5046-4efc-b987-48f1bddde915]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:29 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 Apr 09 16:59:29 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:30 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:30 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160 Apr 09 16:59:30 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:30 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e62e072b-e976-4b3d-a921-4648c282a160" returned: 0 in 0.409s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-e62e072b-e976-4b3d-a921-4648c282a160" released by "delete_volume" :: held 0.915s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created reservations ['54dad738-66f0-493d-8c50-b6faa7c20b17', 'f202da15-8b04-457f-9904-254f3a55b415', '4b02e251-c70d-4e91-8052-59af53e1a164', 'b8bd6118-82fe-41b1-a2f7-5816835b7c4c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:30 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:30 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-eb281d07-d367-425f-b1af-85da39c6821b-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-eb281d07-d367-425f-b1af-85da39c6821b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-quobyte-eb281d07-d367-425f-b1af-85da39c6821b" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-eb281d07-d367-425f-b1af-85da39c6821b" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8792f5d-9e98-48b1-b5a9-eb8f28882820]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:30 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b Apr 09 16:59:30 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:31 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.434s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:31 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Deleted volume successfully. Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-07e431ca-74be-41d1-9935-c9f99b7f7b7c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-e62e072b-e976-4b3d-a921-4648c282a160-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:31 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:31 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b Apr 09 16:59:31 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:31 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-eb281d07-d367-425f-b1af-85da39c6821b" returned: 0 in 0.410s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-eb281d07-d367-425f-b1af-85da39c6821b" released by "delete_volume" :: held 0.927s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created reservations ['96dadfea-e968-4912-a236-d7a500c42026', 'ee40c8b5-d7f9-4f11-afbf-92df8c5afd3a', '7b7609be-57f4-469e-a266-cbd6b3416aa0', '7afd7154-71b1-4058-b893-2c0d1bf73065'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:31 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:31 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-8411b1b5-cb59-4823-8b6a-a74b7b38bf81-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-8411b1b5-cb59-4823-8b6a-a74b7b38bf81-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-quobyte-8411b1b5-cb59-4823-8b6a-a74b7b38bf81" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-8411b1b5-cb59-4823-8b6a-a74b7b38bf81" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca500c-62e5-4294-80d5-857a9a9279b3]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:32 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 Apr 09 16:59:32 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:32 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.425s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:32 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Deleted volume successfully. Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1961b32-4111-49b6-a6e4-a02d900aba0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-eb281d07-d367-425f-b1af-85da39c6821b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:32 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:32 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81 Apr 09 16:59:32 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:32 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8411b1b5-cb59-4823-8b6a-a74b7b38bf81" returned: 0 in 0.442s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-8411b1b5-cb59-4823-8b6a-a74b7b38bf81" released by "delete_volume" :: held 0.958s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:32 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created reservations ['a68ae3f8-2572-4f5f-9c04-5dea36e532f7', '883800cf-1fc5-4124-ad57-63ae44d3a9b4', '2d99eef3-e0d9-47bf-8660-1494bffb98b8', '8451897f-406f-4229-b6d2-2e3339559f81'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:33 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:33 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-0cb26407-7a30-4cd4-872e-80ed8afb2a0c-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-0cb26407-7a30-4cd4-872e-80ed8afb2a0c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-quobyte-0cb26407-7a30-4cd4-872e-80ed8afb2a0c" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-0cb26407-7a30-4cd4-872e-80ed8afb2a0c" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[25465369-7160-4542-a73d-52f7bcaf12a8]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:33 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c Apr 09 16:59:33 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:33 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.413s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:33 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Deleted volume successfully. Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-509b0e6f-9270-4c69-b36d-6eba7d49bb0c tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-8411b1b5-cb59-4823-8b6a-a74b7b38bf81-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:33 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c" returned: 0 in 0.471s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:33 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c Apr 09 16:59:33 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:34 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0cb26407-7a30-4cd4-872e-80ed8afb2a0c" returned: 0 in 0.427s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-0cb26407-7a30-4cd4-872e-80ed8afb2a0c" released by "delete_volume" :: held 0.923s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created reservations ['f2596007-50b1-43b5-98ae-ccb3cddc9880', '80542ee9-874f-4f6d-8e52-8260d3449d5e', 'f3fca749-b0cf-410f-bcef-91e945981270', '5ad78e73-c00d-4246-b815-58598e8df411'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:34 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:34 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-6b060428-c483-4d49-97ad-33e6f011bc4a-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-6b060428-c483-4d49-97ad-33e6f011bc4a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-quobyte-6b060428-c483-4d49-97ad-33e6f011bc4a" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-6b060428-c483-4d49-97ad-33e6f011bc4a" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa12932e-596c-4ccd-9095-8f667f86264b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:34 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a Apr 09 16:59:34 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:34 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.410s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:34 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Deleted volume successfully. Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c9b6e3e7-7829-4c21-a9eb-70ebe6ef84c4 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-0cb26407-7a30-4cd4-872e-80ed8afb2a0c-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:34 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:34 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a Apr 09 16:59:34 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:35 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-6b060428-c483-4d49-97ad-33e6f011bc4a" returned: 0 in 0.411s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-6b060428-c483-4d49-97ad-33e6f011bc4a" released by "delete_volume" :: held 0.914s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created reservations ['2526ddaa-2707-4f64-b919-c38c3ba56c78', '15774098-021d-4355-aa9d-be5db1e0dc38', '637faf10-f62b-41d8-b773-5d71e7d715ce', '03f1f1d8-a52e-414f-82f6-7fc527e7bc26'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:35 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:35 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-0f7b7246-eb70-403d-8214-66db20412639-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-0f7b7246-eb70-403d-8214-66db20412639-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "cinder-quobyte-0f7b7246-eb70-403d-8214-66db20412639" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-0f7b7246-eb70-403d-8214-66db20412639" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[677e7b17-62a2-42e9-b454-3b97e3194980]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:35 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 Apr 09 16:59:35 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:35 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.401s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:35 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Deleted volume successfully. Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e756592e-b2ce-4082-8324-584c3465c8d1 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-6b060428-c483-4d49-97ad-33e6f011bc4a-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:35 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:35 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639 Apr 09 16:59:35 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:36 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0f7b7246-eb70-403d-8214-66db20412639" returned: 0 in 0.419s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-quobyte-0f7b7246-eb70-403d-8214-66db20412639" released by "delete_volume" :: held 0.915s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Created reservations ['b9bf1c17-9886-472a-8611-c2ac4887089a', 'b6b1f431-95d2-4e0c-8a65-090c44ca0dd0', 'baa8daac-6e5d-4cd0-b44b-581551f59413', 'd3f2f69d-549a-4477-b595-a8e4112439e3'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:36 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:36 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:36 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.442s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:36 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Deleted volume successfully. Apr 09 16:59:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-911b1590-de75-44fe-9c72-f7b87d70cc97 tempest-CreateVolumesFromSourceVolumeTest-1505258640 None] Lock "cinder-0f7b7246-eb70-403d-8214-66db20412639-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Flow 'volume_create_manager' (f5a23b23-8e3f-48cd-b608-dd32fb1bf66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08dff71b-bfa7-45d7-b88e-4f5f52d22c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08dff71b-bfa7-45d7-b88e-4f5f52d22c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-117937033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89560ea-732d-4780-9450-2d7d0b8f75f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4895a7497c944158d980bc18c00c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:38Z,use_quota=True,user_id='331b38438f6c487688168b9127108155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03ce02a-ce8a-4d67-b570-c81425dc766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03ce02a-ce8a-4d67-b570-c81425dc766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfdf736-601c-4ac0-87f6-2d9eaf980a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfdf736-601c-4ac0-87f6-2d9eaf980a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89560ea-732d-4780-9450-2d7d0b8f75f3', 'volume_name': 'volume-e89560ea-732d-4780-9450-2d7d0b8f75f3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4ecb46-513c-420f-9c79-1e468ab7191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4ecb46-513c-420f-9c79-1e468ab7191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4e0a12-99ed-4c99-866a-d36f672a8420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:38 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Volume e89560ea-732d-4780-9450-2d7d0b8f75f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89560ea-732d-4780-9450-2d7d0b8f75f3', 'volume_size': 1} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-117937033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89560ea-732d-4780-9450-2d7d0b8f75f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4895a7497c944158d980bc18c00c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:38Z,use_quota=True,user_id='331b38438f6c487688168b9127108155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Creating volume e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:38 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:38 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 1073741824 Apr 09 16:59:38 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:38 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 1073741824" returned: 0 in 0.461s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:38 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 Apr 09 16:59:38 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:38 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3" returned: 0 in 0.411s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4e0a12-99ed-4c99-866a-d36f672a8420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89560ea-732d-4780-9450-2d7d0b8f75f3', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59dd49c4-70d7-4eab-832e-a0db9100670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Volume volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 (e89560ea-732d-4780-9450-2d7d0b8f75f3): created successfully Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59dd49c4-70d7-4eab-832e-a0db9100670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Flow 'volume_create_manager' (f5a23b23-8e3f-48cd-b608-dd32fb1bf66e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:39 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-05f44e2b-1212-4078-83c2-836cd3766bbe tempest-VolumeDependencyTests-1442433109 None] Created volume successfully. Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Creating offline snapshot 6dfdc689-8606-40c2-b2a3-0c1105fb6120 of volume e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[671e2a22-4831-4d5b-8d27-e9674bf08531]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:39 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 Apr 09 16:59:39 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:39 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3" returned: 0 in 0.456s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:39 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 1G Apr 09 16:59:39 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:40 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 1G" returned: 0 in 0.451s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:40 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 Apr 09 16:59:40 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:40 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120" returned: 0 in 0.411s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:40 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 is being set with open permissions: ugo+rw Apr 09 16:59:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:40 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 Apr 09 16:59:40 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:40 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120" returned: 0 in 0.396s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:40 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.info Apr 09 16:59:41 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:41 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.info" returned: 0 in 0.408s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:41 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.info is being set with open permissions: ugo+rw Apr 09 16:59:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:41 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.info Apr 09 16:59:41 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:41 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.info" returned: 0 in 0.406s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.586s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:41 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ac7da87f-b467-4b81-9644-4523f27cd13e tempest-VolumeDependencyTests-1442433109 None] Create snapshot completed successfully Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Flow 'volume_create_manager' (a0d356e5-a7d2-47f0-add9-ab3c0d63f40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cb4a99-4f30-4426-9ba0-f21de8fac06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cb4a99-4f30-4426-9ba0-f21de8fac06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-937399309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba3aeaf-664c-43c3-aa09-96292bae184f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4895a7497c944158d980bc18c00c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6dfdc689-8606-40c2-b2a3-0c1105fb6120,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:43Z,use_quota=True,user_id='331b38438f6c487688168b9127108155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294b6353-58bd-4dd7-9b55-36aaaa94d9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294b6353-58bd-4dd7-9b55-36aaaa94d9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5aebd0-a0ee-4bf1-9731-a4ea54acb2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5aebd0-a0ee-4bf1-9731-a4ea54acb2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aba3aeaf-664c-43c3-aa09-96292bae184f', 'volume_name': 'volume-aba3aeaf-664c-43c3-aa09-96292bae184f', 'volume_size': 1, 'snapshot_id': '6dfdc689-8606-40c2-b2a3-0c1105fb6120'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2523ca-17aa-4a44-adb3-1be9c922898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2523ca-17aa-4a44-adb3-1be9c922898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a822fe73-b4e8-4275-895e-0a5ad7326bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:42 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Volume aba3aeaf-664c-43c3-aa09-96292bae184f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aba3aeaf-664c-43c3-aa09-96292bae184f', 'volume_size': 1, 'snapshot_id': '6dfdc689-8606-40c2-b2a3-0c1105fb6120'} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-6dfdc689-8606-40c2-b2a3-0c1105fb6120-aba3aeaf-664c-43c3-aa09-96292bae184f" by "_create_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-6dfdc689-8606-40c2-b2a3-0c1105fb6120-aba3aeaf-664c-43c3-aa09-96292bae184f" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Creating volume aba3aeaf-664c-43c3-aa09-96292bae184f from snapshot 6dfdc689-8606-40c2-b2a3-0c1105fb6120 {{(pid=82139) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-aba3aeaf-664c-43c3-aa09-96292bae184f" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-aba3aeaf-664c-43c3-aa09-96292bae184f" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] snapshot: 6dfdc689-8606-40c2-b2a3-0c1105fb6120, volume: aba3aeaf-664c-43c3-aa09-96292bae184f, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1c605a-92e0-45ee-b0f2-49f9824b69d4]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:42 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 Apr 09 16:59:42 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:43 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120" returned: 0 in 0.475s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e89560ea-732d-4780-9450-2d7d0b8f75f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae77ca-e2ad-42f8-b221-a62a730a859b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:43 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 Apr 09 16:59:43 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:43 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:59:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:43 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f Apr 09 16:59:43 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:45 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f" returned: 0 in 1.907s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:45 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d248f6-d6bf-4491-8168-45571dab7005]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:45 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 Apr 09 16:59:45 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:46 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3" returned: 0 in 0.587s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:59:46 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Converted 1024.00 MB image at 536.57 MB/s Apr 09 16:59:46 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f is being set with open permissions: ugo+rw Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:46 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f Apr 09 16:59:46 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:46 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f" returned: 0 in 0.402s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-aba3aeaf-664c-43c3-aa09-96292bae184f" released by "_copy_volume_from_snapshot" :: held 3.896s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-6dfdc689-8606-40c2-b2a3-0c1105fb6120-aba3aeaf-664c-43c3-aa09-96292bae184f" released by "_create_volume_from_snapshot" :: held 3.912s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.922s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a822fe73-b4e8-4275-895e-0a5ad7326bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba3aeaf-664c-43c3-aa09-96292bae184f', 'volume_size': 1, 'snapshot_id': '6dfdc689-8606-40c2-b2a3-0c1105fb6120'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7804569-1080-4eba-9456-9a7f3a767dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:46 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Volume volume-aba3aeaf-664c-43c3-aa09-96292bae184f (aba3aeaf-664c-43c3-aa09-96292bae184f): created successfully Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7804569-1080-4eba-9456-9a7f3a767dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Flow 'volume_create_manager' (a0d356e5-a7d2-47f0-add9-ab3c0d63f40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:46 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e1c8c0bd-6de2-4d51-ba83-fc0fc8ba0e7c tempest-VolumeDependencyTests-1442433109 None] Created volume successfully. Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-6dfdc689-8606-40c2-b2a3-0c1105fb6120-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-6dfdc689-8606-40c2-b2a3-0c1105fb6120-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-e89560ea-732d-4780-9450-2d7d0b8f75f3" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-e89560ea-732d-4780-9450-2d7d0b8f75f3" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-6dfdc689-8606-40c2-b2a3-0c1105fb6120" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-6dfdc689-8606-40c2-b2a3-0c1105fb6120" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Deleting offline snapshot 6dfdc689-8606-40c2-b2a3-0c1105fb6120 of volume e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] snapshot_file for this snap is: volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[941c3142-974f-44d9-829d-7cc06c507124]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:46 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 Apr 09 16:59:46 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:47 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120" returned: 0 in 0.463s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e89560ea-732d-4780-9450-2d7d0b8f75f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:59:47 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[84514507-bb35-41ae-8950-5378be2eefea]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:47 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 Apr 09 16:59:47 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:47 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3" returned: 0 in 0.470s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:47 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 Apr 09 16:59:47 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:48 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120" returned: 0 in 0.455s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:48 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120 Apr 09 16:59:48 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:48 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3.6dfdc689-8606-40c2-b2a3-0c1105fb6120" returned: 0 in 0.413s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-6dfdc689-8606-40c2-b2a3-0c1105fb6120" released by "_delete_snapshot" :: held 1.852s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-e89560ea-732d-4780-9450-2d7d0b8f75f3" released by "delete_snapshot" :: held 1.864s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:48 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Created reservations ['4ca82613-e0bf-44e4-a3a9-51e7ea967e26', 'bb74c952-158a-4561-9b59-5f7b0c596928', 'c4be8b24-4851-451f-9820-058174dd953e', '122543b8-781f-4bd0-bc12-b5d992bc3eb8'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:48 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Delete snapshot completed successfully. Apr 09 16:59:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-55876da7-310e-41b0-b717-5310d1188183 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-6dfdc689-8606-40c2-b2a3-0c1105fb6120-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-e89560ea-732d-4780-9450-2d7d0b8f75f3-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-e89560ea-732d-4780-9450-2d7d0b8f75f3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-e89560ea-732d-4780-9450-2d7d0b8f75f3" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-e89560ea-732d-4780-9450-2d7d0b8f75f3" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[6016f3ab-ad1b-4eca-978e-0cf0a9f4ea73]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:49 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 Apr 09 16:59:49 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:49 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3" returned: 0 in 0.473s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:49 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3 Apr 09 16:59:49 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:49 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-e89560ea-732d-4780-9450-2d7d0b8f75f3" returned: 0 in 0.411s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-e89560ea-732d-4780-9450-2d7d0b8f75f3" released by "delete_volume" :: held 0.919s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:49 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Created reservations ['1a3bf7f3-d0a8-4976-b96d-b2aa6f8b355f', 'b4b9a967-7e6e-49be-a025-8bbcd84a61bd', 'd1c239bb-5f3a-4c0e-8e7a-ae6e368d7bbd', 'fbc0d8c2-a3b6-48aa-a0f9-90371c701dca'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:50 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 16:59:50 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Flow 'volume_create_manager' (87538f3b-09d5-4c16-9029-dec182425105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3b0fd7-279d-481d-b7b4-abbd499bf2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3b0fd7-279d-481d-b7b4-abbd499bf2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-718753377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fdcf7a-69a0-4906-bba9-0772d41b1cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4895a7497c944158d980bc18c00c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:50Z,use_quota=True,user_id='331b38438f6c487688168b9127108155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800288fc-f6ab-4b6f-941d-aaa1e44ca24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800288fc-f6ab-4b6f-941d-aaa1e44ca24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ec2b7e-8a46-4b8c-9902-ea0a4b62dcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ec2b7e-8a46-4b8c-9902-ea0a4b62dcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fdcf7a-69a0-4906-bba9-0772d41b1cef', 'volume_name': 'volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc74645-590b-4927-915b-54f62d304082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc74645-590b-4927-915b-54f62d304082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d4eae1-8036-4854-adee-e5edb235a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:50 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Volume 85fdcf7a-69a0-4906-bba9-0772d41b1cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef', 'volume_size': 1} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-718753377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fdcf7a-69a0-4906-bba9-0772d41b1cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4895a7497c944158d980bc18c00c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:50Z,use_quota=True,user_id='331b38438f6c487688168b9127108155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Creating volume 85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 16:59:50 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:50 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef 1073741824 Apr 09 16:59:50 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:50 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.453s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 16:59:50 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Deleted volume successfully. Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-35911cfd-4e1e-466e-a0c1-94d468b75ebe tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-e89560ea-732d-4780-9450-2d7d0b8f75f3-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:50 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef 1073741824" returned: 0 in 0.469s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:50 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef Apr 09 16:59:50 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:51 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:51 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 16:59:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d4eae1-8036-4854-adee-e5edb235a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9a1ca5-96e5-4a26-989a-cb0eef764df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:51 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Volume volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef (85fdcf7a-69a0-4906-bba9-0772d41b1cef): created successfully Apr 09 16:59:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9a1ca5-96e5-4a26-989a-cb0eef764df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:51 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Flow 'volume_create_manager' (87538f3b-09d5-4c16-9029-dec182425105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:51 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f66d32b8-7dd3-4593-8237-f9a9b07df660 tempest-VolumeDependencyTests-1442433109 None] Created volume successfully. Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Flow 'volume_create_manager' (a307205d-a8f8-4209-ac27-f9122220bd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dfbba8-29de-4e81-ba7a-f2690f518321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dfbba8-29de-4e81-ba7a-f2690f518321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T14:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1047721021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89444b17-bee4-47d1-a29d-1bca5fab7820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4895a7497c944158d980bc18c00c6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T14:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=85fdcf7a-69a0-4906-bba9-0772d41b1cef,status='creating',terminated_at=None,updated_at=2026-04-09T14:59:53Z,use_quota=True,user_id='331b38438f6c487688168b9127108155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d339a76-7999-4402-af47-5ea70a3e4f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d339a76-7999-4402-af47-5ea70a3e4f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d05ec5-7a66-4ee0-8124-23981cd30a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d05ec5-7a66-4ee0-8124-23981cd30a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '89444b17-bee4-47d1-a29d-1bca5fab7820', 'volume_name': 'volume-89444b17-bee4-47d1-a29d-1bca5fab7820', 'volume_size': 1, 'source_volid': '85fdcf7a-69a0-4906-bba9-0772d41b1cef', 'source_volstatus': 'available'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271b6f05-5b16-43bf-afd7-687de1394d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271b6f05-5b16-43bf-afd7-687de1394d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354e6b6b-00a8-4f7a-acbd-3428fd4fd0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 16:59:52 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Volume 89444b17-bee4-47d1-a29d-1bca5fab7820: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-89444b17-bee4-47d1-a29d-1bca5fab7820', 'volume_size': 1, 'source_volid': '85fdcf7a-69a0-4906-bba9-0772d41b1cef', 'source_volstatus': 'available'} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:52 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Cloning volume 85fdcf7a-69a0-4906-bba9-0772d41b1cef to volume 89444b17-bee4-47d1-a29d-1bca5fab7820 Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Creating offline snapshot 6179cca9-2907-4f15-9a13-a1940ad16a49 of volume 85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27b2961-6ae0-461e-905e-1feb54d77895]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:52 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef Apr 09 16:59:52 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:53 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef" returned: 0 in 0.466s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:53 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 1G Apr 09 16:59:53 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:53 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 1G" returned: 0 in 0.479s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:53 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 Apr 09 16:59:53 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:54 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49" returned: 0 in 0.442s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:54 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 is being set with open permissions: ugo+rw Apr 09 16:59:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:54 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 Apr 09 16:59:54 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:54 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49" returned: 0 in 0.409s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:54 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.info Apr 09 16:59:54 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:54 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.info" returned: 0 in 0.409s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:54 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.info is being set with open permissions: ugo+rw Apr 09 16:59:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:55 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.info Apr 09 16:59:55 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:55 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.info" returned: 0 in 0.397s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-89444b17-bee4-47d1-a29d-1bca5fab7820" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-89444b17-bee4-47d1-a29d-1bca5fab7820" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] snapshot: 6179cca9-2907-4f15-9a13-a1940ad16a49, volume: 89444b17-bee4-47d1-a29d-1bca5fab7820, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c38390-8d50-4ae3-9cba-87215955d067]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:55 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 Apr 09 16:59:55 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:55 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49" returned: 0 in 0.475s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6c5dcc-567c-4d77-90f9-afcfeb8438fb]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:55 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef Apr 09 16:59:55 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:56 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef" returned: 0 in 0.458s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:56 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 16:59:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:56 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 Apr 09 16:59:56 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:58 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820" returned: 0 in 1.922s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:58 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8d66ca-4fc9-4e52-bc4a-a3c4af908e97]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:58 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef Apr 09 16:59:58 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:58 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef" returned: 0 in 0.571s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:58 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 16:59:58 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Converted 1024.00 MB image at 532.34 MB/s Apr 09 16:59:58 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 is being set with open permissions: ugo+rw Apr 09 16:59:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:58 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 Apr 09 16:59:58 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:59 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820" returned: 0 in 0.427s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-89444b17-bee4-47d1-a29d-1bca5fab7820" released by "_copy_volume_from_snapshot" :: held 3.901s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-6179cca9-2907-4f15-9a13-a1940ad16a49" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-6179cca9-2907-4f15-9a13-a1940ad16a49" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Deleting offline snapshot 6179cca9-2907-4f15-9a13-a1940ad16a49 of volume 85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] snapshot_file for this snap is: volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc68d4b-05c8-4fe0-906b-94b33796b961]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:59 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 Apr 09 16:59:59 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 16:59:59 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49" returned: 0 in 0.469s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3a0a78-033d-4c57-978e-341a0b2a3bb3]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 16:59:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 16:59:59 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef Apr 09 16:59:59 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:00 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef" returned: 0 in 0.471s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:00 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 Apr 09 17:00:00 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:00 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49" returned: 0 in 0.431s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:00 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49 Apr 09 17:00:00 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:01 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef.6179cca9-2907-4f15-9a13-a1940ad16a49" returned: 0 in 0.424s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-6179cca9-2907-4f15-9a13-a1940ad16a49" released by "_delete_snapshot" :: held 1.840s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.453s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354e6b6b-00a8-4f7a-acbd-3428fd4fd0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89444b17-bee4-47d1-a29d-1bca5fab7820', 'volume_size': 1, 'source_volid': '85fdcf7a-69a0-4906-bba9-0772d41b1cef', 'source_volstatus': 'available'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083c01d5-8a2f-4294-9018-0955d422b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:01 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Volume volume-89444b17-bee4-47d1-a29d-1bca5fab7820 (89444b17-bee4-47d1-a29d-1bca5fab7820): created successfully Apr 09 17:00:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083c01d5-8a2f-4294-9018-0955d422b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Flow 'volume_create_manager' (a307205d-a8f8-4209-ac27-f9122220bd12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:01 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-975255cb-1c81-4b16-876c-19c7084c71b0 tempest-VolumeDependencyTests-1442433109 None] Created volume successfully. Apr 09 17:00:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-85fdcf7a-69a0-4906-bba9-0772d41b1cef-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-85fdcf7a-69a0-4906-bba9-0772d41b1cef-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-85fdcf7a-69a0-4906-bba9-0772d41b1cef" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-85fdcf7a-69a0-4906-bba9-0772d41b1cef" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b272c-ea3f-4327-b30d-a6bb9a184912]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:02 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef Apr 09 17:00:02 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:02 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef" returned: 0 in 0.455s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:02 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef Apr 09 17:00:02 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:03 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-85fdcf7a-69a0-4906-bba9-0772d41b1cef" returned: 0 in 0.412s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-85fdcf7a-69a0-4906-bba9-0772d41b1cef" released by "delete_volume" :: held 0.898s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Created reservations ['63031bab-cac7-4d36-97ad-59792d0766ca', '792464c1-df08-45d7-b3d3-b3bf49360762', '1b037ed2-d5fb-4137-bfa5-92d52289fe1b', 'ca0cf0e8-7b3f-47b9-a031-dc0fe298d7c4'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:03 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:03 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-89444b17-bee4-47d1-a29d-1bca5fab7820-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-89444b17-bee4-47d1-a29d-1bca5fab7820-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-89444b17-bee4-47d1-a29d-1bca5fab7820" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-89444b17-bee4-47d1-a29d-1bca5fab7820" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66f2f44-a6ef-44b3-af2f-0c6af4ab8957]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:03 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 Apr 09 17:00:03 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:03 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.431s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Deleted volume successfully. Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-d3ae549a-ab8f-454b-b4fd-bcc51aa83f21 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-85fdcf7a-69a0-4906-bba9-0772d41b1cef-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:03 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820" returned: 0 in 0.488s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:03 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820 Apr 09 17:00:03 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:04 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-89444b17-bee4-47d1-a29d-1bca5fab7820" returned: 0 in 0.422s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-89444b17-bee4-47d1-a29d-1bca5fab7820" released by "delete_volume" :: held 0.934s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Created reservations ['03fc0abf-41fc-4b70-ad05-16a71fec6bc7', 'f4d5e0eb-1c2f-416b-aecf-b37b18a03a62', '6c0eed14-8d90-4aa5-b79e-1968857fa7e4', '62b67d5e-4c78-46d9-bfcc-ae0ea2be02d5'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:04 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:04 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-aba3aeaf-664c-43c3-aa09-96292bae184f-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-aba3aeaf-664c-43c3-aa09-96292bae184f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "cinder-quobyte-aba3aeaf-664c-43c3-aa09-96292bae184f" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-aba3aeaf-664c-43c3-aa09-96292bae184f" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50333c6-a6c6-44b0-907c-90d8c258de8b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:04 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f Apr 09 17:00:04 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:04 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.437s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:04 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Deleted volume successfully. Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-398c016c-9b8b-4e2d-a5be-c8a09cf78600 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-89444b17-bee4-47d1-a29d-1bca5fab7820-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:04 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f" returned: 0 in 0.482s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:04 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f Apr 09 17:00:04 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:05 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-aba3aeaf-664c-43c3-aa09-96292bae184f" returned: 0 in 0.415s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-quobyte-aba3aeaf-664c-43c3-aa09-96292bae184f" released by "delete_volume" :: held 0.918s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Created reservations ['28d88ce0-64aa-4364-8ffe-01c51506b925', '14ea4010-437f-4943-b8e9-7e69b00103d9', 'c376731a-2c6f-4c10-8a86-92ebd5972c31', '744d8993-ebc7-4f78-9caf-d28ec4ac46dc'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:05 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:05 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:05 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.458s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:05 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Deleted volume successfully. Apr 09 17:00:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2459fa06-9df3-4033-a074-0efcdb6a1ed5 tempest-VolumeDependencyTests-1442433109 None] Lock "cinder-aba3aeaf-664c-43c3-aa09-96292bae184f-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (f4a21056-970c-48ab-ae4d-390533c7162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0772f12f-e742-439f-b7c4-0146bef7ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0772f12f-e742-439f-b7c4-0146bef7ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1825313148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5423aeee-c6cd-481e-a897-cf449159c57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cfb860-ad0e-4ca6-ab82-eeb8d8aef888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cfb860-ad0e-4ca6-ab82-eeb8d8aef888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c0a300-d47d-4fa2-8263-91ed9e8150dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c0a300-d47d-4fa2-8263-91ed9e8150dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5423aeee-c6cd-481e-a897-cf449159c57e', 'volume_name': 'volume-5423aeee-c6cd-481e-a897-cf449159c57e', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffab2e1-a0e7-4a6f-84c4-1b31d1d94a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffab2e1-a0e7-4a6f-84c4-1b31d1d94a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c54eb3-a149-4186-a1bd-12e03b09c4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Volume 5423aeee-c6cd-481e-a897-cf449159c57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5423aeee-c6cd-481e-a897-cf449159c57e', 'volume_size': 1} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1825313148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5423aeee-c6cd-481e-a897-cf449159c57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Creating volume 5423aeee-c6cd-481e-a897-cf449159c57e {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:12 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:12 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e 1073741824 Apr 09 17:00:12 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (9ac1df9b-1393-4fdd-b9cd-ee2c0c073936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb41dac2-eca9-416c-9cc7-1afb47e5ca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb41dac2-eca9-416c-9cc7-1afb47e5ca31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1973132066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4a8abf-c87a-4668-bffe-189cc004a6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ea458a-0b62-4122-aa0d-d82b9348249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ea458a-0b62-4122-aa0d-d82b9348249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8be0a3-48e4-4138-b955-339403803779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8be0a3-48e4-4138-b955-339403803779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4a8abf-c87a-4668-bffe-189cc004a6a6', 'volume_name': 'volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0faef1-fac6-4b1b-a00f-2657108de9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0faef1-fac6-4b1b-a00f-2657108de9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a1eeb-af11-4bbe-963e-22f215d0b012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:12 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume 3c4a8abf-c87a-4668-bffe-189cc004a6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6', 'volume_size': 1} Apr 09 17:00:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (a82c8c07-19c9-43ab-a7a7-ec4e5f09c41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d828d38-515c-4b93-ae53-2179b1ca3397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Flow 'volume_create_manager' (7157e38b-2173-4450-b6de-859801b92866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37291ba6-e9f3-4330-9aa4-ffd7a9854c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d828d38-515c-4b93-ae53-2179b1ca3397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532584493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d11411-cb86-4999-b256-e096099f1722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca4b316-31e4-4605-a346-8037e49a9c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca4b316-31e4-4605-a346-8037e49a9c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a949a6a-5efd-4750-be72-33a2ca365325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a949a6a-5efd-4750-be72-33a2ca365325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d11411-cb86-4999-b256-e096099f1722', 'volume_name': 'volume-d9d11411-cb86-4999-b256-e096099f1722', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8ddca7-10e4-419f-945e-07e0e9bf2b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8ddca7-10e4-419f-945e-07e0e9bf2b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f033b3b-980a-4278-a702-e3b77af510fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Volume d9d11411-cb86-4999-b256-e096099f1722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d11411-cb86-4999-b256-e096099f1722', 'volume_size': 1} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37291ba6-e9f3-4330-9aa4-ffd7a9854c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1216339182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992322fc-644c-4a41-90cf-639454b664eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4e24f44f554a88acdffe585cc17db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='e276ea0d18034c469af0b8b7eb3a72b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122e508d-6886-42eb-91f2-14f9153157d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122e508d-6886-42eb-91f2-14f9153157d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502422de-104d-454a-a508-7e7788fd1996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502422de-104d-454a-a508-7e7788fd1996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992322fc-644c-4a41-90cf-639454b664eb', 'volume_name': 'volume-992322fc-644c-4a41-90cf-639454b664eb', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07826efb-2d8a-4be0-971d-1f4b1839274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07826efb-2d8a-4be0-971d-1f4b1839274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cca55-f5b5-4596-a46d-6c3dbe3be9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Volume 992322fc-644c-4a41-90cf-639454b664eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992322fc-644c-4a41-90cf-639454b664eb', 'volume_size': 1} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (21b8f188-a631-49b0-80ff-da3265142566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2275e4-6934-4b30-a081-a31da6481728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2275e4-6934-4b30-a081-a31da6481728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-457838236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c662ea1-b3ea-4ace-8f10-193d719da06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3474a689-8cac-474e-8f0f-33a71117e35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3474a689-8cac-474e-8f0f-33a71117e35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7e7ad6-8cd6-4bf7-b1e0-d691ce563392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7e7ad6-8cd6-4bf7-b1e0-d691ce563392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c662ea1-b3ea-4ace-8f10-193d719da06e', 'volume_name': 'volume-7c662ea1-b3ea-4ace-8f10-193d719da06e', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15613899-04f1-4654-a32d-5f1995bd4f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15613899-04f1-4654-a32d-5f1995bd4f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5f706b-8258-4898-a1b8-56090191238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Volume 7c662ea1-b3ea-4ace-8f10-193d719da06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c662ea1-b3ea-4ace-8f10-193d719da06e', 'volume_size': 1} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (d9271fe4-6ca0-4355-b3ba-3244cd13a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a60b336-6b8c-477d-97e8-7f7df5b55f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a60b336-6b8c-477d-97e8-7f7df5b55f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1700790592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d62898a-d14d-4d5b-893d-3fe7facccc21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15c9619-ca1b-4b6c-92a9-4b17413be0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15c9619-ca1b-4b6c-92a9-4b17413be0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ae2f2d-7e8d-4cc2-9e70-50c4a8bc39f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ae2f2d-7e8d-4cc2-9e70-50c4a8bc39f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d62898a-d14d-4d5b-893d-3fe7facccc21', 'volume_name': 'volume-3d62898a-d14d-4d5b-893d-3fe7facccc21', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c32d64-bbdb-4318-93a4-8d9a7d8d3c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c32d64-bbdb-4318-93a4-8d9a7d8d3c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b4a7c8-6d89-49f0-957c-0309a008f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Volume 3d62898a-d14d-4d5b-893d-3fe7facccc21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d62898a-d14d-4d5b-893d-3fe7facccc21', 'volume_size': 1} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:13 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e 1073741824" returned: 0 in 0.672s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:13 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e Apr 09 17:00:13 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (9a232368-d518-46a4-b38f-5844f080ffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fad140f-6dc7-4074-9344-b1bea355bcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fad140f-6dc7-4074-9344-b1bea355bcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-534005889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7c0103-799d-4ddb-9b4d-c23f156cf285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:14Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9067959-ff48-4c86-a082-5a4fc2ac6297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9067959-ff48-4c86-a082-5a4fc2ac6297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4985a6c7-9ba9-483e-b92e-426f7158ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4985a6c7-9ba9-483e-b92e-426f7158ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7c0103-799d-4ddb-9b4d-c23f156cf285', 'volume_name': 'volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af184565-d0d0-459b-83ee-9700363c9b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af184565-d0d0-459b-83ee-9700363c9b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20df4ea0-3a82-42c7-90b5-de7450f87332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:13 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Volume 4b7c0103-799d-4ddb-9b4d-c23f156cf285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285', 'volume_size': 1} Apr 09 17:00:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:14 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e" returned: 0 in 0.565s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1973132066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4a8abf-c87a-4668-bffe-189cc004a6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Creating volume 3c4a8abf-c87a-4668-bffe-189cc004a6a6 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:14 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:14 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:14 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c54eb3-a149-4186-a1bd-12e03b09c4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5423aeee-c6cd-481e-a897-cf449159c57e', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:14 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 1073741824 Apr 09 17:00:14 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d09887-4bfe-4ec3-8a84-9ba45b46e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:14 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Volume volume-5423aeee-c6cd-481e-a897-cf449159c57e (5423aeee-c6cd-481e-a897-cf449159c57e): created successfully Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d09887-4bfe-4ec3-8a84-9ba45b46e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (f4a21056-970c-48ab-ae4d-390533c7162d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e85a60bd-aa25-46f1-8a3f-c6c8be2336d1 tempest-CreateVolumesFromImageTest-1474326306 None] Created volume successfully. Apr 09 17:00:14 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.436s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:14 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 1073741824" returned: 0 in 0.530s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:14 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 Apr 09 17:00:14 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:15 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6" returned: 0 in 0.462s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.043s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532584493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d11411-cb86-4999-b256-e096099f1722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Creating volume d9d11411-cb86-4999-b256-e096099f1722 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:15 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a1eeb-af11-4bbe-963e-22f215d0b012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1a0d77-2870-4345-88b4-b1838580ed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:15 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 1073741824 Apr 09 17:00:15 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:15 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 (3c4a8abf-c87a-4668-bffe-189cc004a6a6): created successfully Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1a0d77-2870-4345-88b4-b1838580ed5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (9ac1df9b-1393-4fdd-b9cd-ee2c0c073936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:15 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-e2ec923b-2f26-426b-a172-7050558ffbbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created volume successfully. Apr 09 17:00:15 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 1073741824" returned: 0 in 0.579s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:15 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 Apr 09 17:00:15 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:15 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:16 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722" returned: 0 in 0.473s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.101s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1216339182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992322fc-644c-4a41-90cf-639454b664eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4e24f44f554a88acdffe585cc17db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='e276ea0d18034c469af0b8b7eb3a72b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Creating volume 992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:16 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f033b3b-980a-4278-a702-e3b77af510fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d11411-cb86-4999-b256-e096099f1722', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afd1f0a-11ed-4c6e-945e-6901d053b033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:16 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb 1073741824 Apr 09 17:00:16 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:16 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Volume volume-d9d11411-cb86-4999-b256-e096099f1722 (d9d11411-cb86-4999-b256-e096099f1722): created successfully Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afd1f0a-11ed-4c6e-945e-6901d053b033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (a82c8c07-19c9-43ab-a7a7-ec4e5f09c41a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:16 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6f78f432-76e9-4974-90ff-b7e52e7f1719 tempest-CreateVolumesFromImageTest-1474326306 None] Created volume successfully. Apr 09 17:00:16 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb 1073741824" returned: 0 in 0.526s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:16 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:16 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb Apr 09 17:00:16 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:17 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb" returned: 0 in 0.469s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.024s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-457838236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c662ea1-b3ea-4ace-8f10-193d719da06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Creating volume 7c662ea1-b3ea-4ace-8f10-193d719da06e {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:17 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cca55-f5b5-4596-a46d-6c3dbe3be9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992322fc-644c-4a41-90cf-639454b664eb', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28a50cf-ed16-42c3-978c-bb5496fc0849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:17 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Volume volume-992322fc-644c-4a41-90cf-639454b664eb (992322fc-644c-4a41-90cf-639454b664eb): created successfully Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28a50cf-ed16-42c3-978c-bb5496fc0849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:17 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e 1073741824 Apr 09 17:00:17 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Flow 'volume_create_manager' (7157e38b-2173-4450-b6de-859801b92866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:17 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-9799ba20-c434-468c-9a7f-664373bf066e tempest-VolumeDependencyTests-1005108956 None] Created volume successfully. Apr 09 17:00:17 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e 1073741824" returned: 0 in 0.581s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:17 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:17 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e Apr 09 17:00:17 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:18 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e" returned: 0 in 0.458s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.853s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1700790592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d62898a-d14d-4d5b-893d-3fe7facccc21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:13Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Creating volume 3d62898a-d14d-4d5b-893d-3fe7facccc21 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:18 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5f706b-8258-4898-a1b8-56090191238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c662ea1-b3ea-4ace-8f10-193d719da06e', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b166a2-de28-4ebf-a784-a7c707f09be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:18 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 1073741824 Apr 09 17:00:18 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:18 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Volume volume-7c662ea1-b3ea-4ace-8f10-193d719da06e (7c662ea1-b3ea-4ace-8f10-193d719da06e): created successfully Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b166a2-de28-4ebf-a784-a7c707f09be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (21b8f188-a631-49b0-80ff-da3265142566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:18 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ffa95664-eb75-4c29-a787-60b21c1de676 tempest-CreateVolumesFromImageTest-1474326306 None] Created volume successfully. Apr 09 17:00:18 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 1073741824" returned: 0 in 0.495s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:18 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:18 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 Apr 09 17:00:18 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:19 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.644s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-534005889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7c0103-799d-4ddb-9b4d-c23f156cf285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad6ae60a1644809a8a75b19aee43278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:14Z,use_quota=True,user_id='ab613b8429bd46e88bf86c5d964d116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Creating volume 4b7c0103-799d-4ddb-9b4d-c23f156cf285 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:19 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=139,cinder:SELECT=85,cinder:INSERT=32,cinder:DELETE=17 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b4a7c8-6d89-49f0-957c-0309a008f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d62898a-d14d-4d5b-893d-3fe7facccc21', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85d52d0-f5a8-445c-aebc-4167f54f9e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:19 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 1073741824 Apr 09 17:00:19 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:19 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Volume volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 (3d62898a-d14d-4d5b-893d-3fe7facccc21): created successfully Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85d52d0-f5a8-445c-aebc-4167f54f9e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (d9271fe4-6ca0-4355-b3ba-3244cd13a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:19 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f82b1ff4-c2cf-4f67-bb5b-2df7fe3efc98 tempest-CreateVolumesFromImageTest-1474326306 None] Created volume successfully. Apr 09 17:00:19 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 1073741824" returned: 0 in 0.563s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:19 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 Apr 09 17:00:19 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:20 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285" returned: 0 in 0.491s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.479s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Creating offline snapshot 451d5de2-d309-41e5-acfa-69348bea551b of volume 3c4a8abf-c87a-4668-bffe-189cc004a6a6 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20df4ea0-3a82-42c7-90b5-de7450f87332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833c86f6-1e59-4e4c-a062-8f994aa5d4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[90570493-833f-45ac-b215-e31a23c13642]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:20 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Volume volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 (4b7c0103-799d-4ddb-9b4d-c23f156cf285): created successfully Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833c86f6-1e59-4e4c-a062-8f994aa5d4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:20 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Flow 'volume_create_manager' (9a232368-d518-46a4-b38f-5844f080ffd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:20 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c6ff263e-2550-4b3a-8370-000bf5d0ebb6 tempest-CreateVolumesFromImageTest-1474326306 None] Created volume successfully. Apr 09 17:00:20 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 Apr 09 17:00:20 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:21 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6" returned: 0 in 0.515s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:21 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b 1G Apr 09 17:00:21 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-4b7c0103-799d-4ddb-9b4d-c23f156cf285-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-4b7c0103-799d-4ddb-9b4d-c23f156cf285-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-quobyte-4b7c0103-799d-4ddb-9b4d-c23f156cf285" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-4b7c0103-799d-4ddb-9b4d-c23f156cf285" acquired by "delete_volume" :: waited 0.026s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a8ced9-65a1-4449-894f-a134bd3ebba6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:21 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 Apr 09 17:00:21 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:21 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b 1G" returned: 0 in 0.585s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:21 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b Apr 09 17:00:21 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:21 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285" returned: 0 in 0.562s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:21 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:21 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285 Apr 09 17:00:21 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:22 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b" returned: 0 in 0.460s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:22 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b is being set with open permissions: ugo+rw Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:22 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b Apr 09 17:00:22 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:22 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-4b7c0103-799d-4ddb-9b4d-c23f156cf285" returned: 0 in 0.480s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-4b7c0103-799d-4ddb-9b4d-c23f156cf285" released by "delete_volume" :: held 1.081s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=111,cinder:UPDATE=139,cinder:INSERT=31,cinder:DELETE=10 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Created reservations ['b00daed1-a1b6-42e2-9474-0494727437a8', 'cea758f1-2a53-4e87-b589-66a8c051d77e', 'da5ef3ac-bd56-4146-85e0-945be0870f32', 'cce553e3-a33d-4882-a8d8-2f24c548e1be'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:22 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:22 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:22 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b" returned: 0 in 0.505s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:22 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.info Apr 09 17:00:22 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:22 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.473s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:22 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Deleted volume successfully. Apr 09 17:00:22 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a4a074e2-bbab-4e24-9337-9643b9539755 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-4b7c0103-799d-4ddb-9b4d-c23f156cf285-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:23 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.info" returned: 0 in 0.485s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:23 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.info is being set with open permissions: ugo+rw Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:23 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.info Apr 09 17:00:23 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-3d62898a-d14d-4d5b-893d-3fe7facccc21-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-3d62898a-d14d-4d5b-893d-3fe7facccc21-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-quobyte-3d62898a-d14d-4d5b-893d-3fe7facccc21" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-3d62898a-d14d-4d5b-893d-3fe7facccc21" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fbf424-f89b-4648-a947-b8019c57fc94]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:23 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.info" returned: 0 in 0.471s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.110s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.297s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:23 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 Apr 09 17:00:23 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Creating offline snapshot 36f94f95-68d7-4949-a9ad-47e062be41c9 of volume 992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:00:23 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-fbf9c2c7-ff5d-4de5-903c-8d73bf25edb5 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Create snapshot completed successfully Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[978524ba-ed9b-4ab2-9482-cc1f17584be6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:23 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:23 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb Apr 09 17:00:23 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:24 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21" returned: 0 in 0.630s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:24 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb" returned: 0 in 0.551s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:24 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21 Apr 09 17:00:24 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:24 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 1G Apr 09 17:00:24 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:24 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (1eac18aa-f695-41b5-bf98-1b019234565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb42c13-bde1-479f-b4c2-23573a257785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3d62898a-d14d-4d5b-893d-3fe7facccc21" returned: 0 in 0.554s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb42c13-bde1-479f-b4c2-23573a257785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-905372400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6e3b66-610e-4581-8bba-9fd3ac3bd052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:25Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3413d1b-7a4a-4fbe-8f05-3b29734223a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3413d1b-7a4a-4fbe-8f05-3b29734223a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db07ac3-2a8d-406a-a819-435676439119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db07ac3-2a8d-406a-a819-435676439119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6e3b66-610e-4581-8bba-9fd3ac3bd052', 'volume_name': 'volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688929aa-6360-4b3c-9007-3d604cf549b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688929aa-6360-4b3c-9007-3d604cf549b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b600118f-3a67-4655-bb47-cf0ff73b1fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:24 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume 5c6e3b66-610e-4581-8bba-9fd3ac3bd052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052', 'volume_size': 1} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-3d62898a-d14d-4d5b-893d-3fe7facccc21" released by "delete_volume" :: held 1.295s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Created reservations ['06a9e480-e356-4c32-ace1-0dd9daceb4d7', '8e7f2919-8f74-43e5-b192-e7cdf3af7167', '9b1617cf-8b36-4e32-a4de-e29007878ae9', '15e5d795-831e-4625-a470-b5f66dc5350a'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (3fd45140-63a5-44b7-8386-0bc1c930d55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b1b0c1-98fa-4994-b6d3-c18e867e796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b1b0c1-98fa-4994-b6d3-c18e867e796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-393562935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c14b9e6-3683-43e0-aff1-36c81765e893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:25Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19370bbb-3383-4661-9f85-b6d3112b1372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:24 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19370bbb-3383-4661-9f85-b6d3112b1372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90c2e5f-a7f0-4438-845c-91806e1054d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90c2e5f-a7f0-4438-845c-91806e1054d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c14b9e6-3683-43e0-aff1-36c81765e893', 'volume_name': 'volume-3c14b9e6-3683-43e0-aff1-36c81765e893', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e4bccf-2988-4f54-a1b2-4b064b6b2721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e4bccf-2988-4f54-a1b2-4b064b6b2721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ff07f3-0e2a-407e-8486-0d10f7d8ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume 3c14b9e6-3683-43e0-aff1-36c81765e893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c14b9e6-3683-43e0-aff1-36c81765e893', 'volume_size': 1} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 1G" returned: 0 in 0.885s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992322fc-644c-4a41-90cf-639454b664eb -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:25 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992322fc-644c-4a41-90cf-639454b664eb -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (690b08b3-767e-44ad-8c43-e44c894a14ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:25 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d458c50b-44cc-4fd9-a061-02173d4df959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d458c50b-44cc-4fd9-a061-02173d4df959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624342756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4d378c-ae38-4fd0-baef-ce74695fab99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:25Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94555d3-af77-424b-9e4c-22c12f78d818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94555d3-af77-424b-9e4c-22c12f78d818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ebbe16-012f-4101-af7b-31d87ab2eade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ebbe16-012f-4101-af7b-31d87ab2eade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4d378c-ae38-4fd0-baef-ce74695fab99', 'volume_name': 'volume-0a4d378c-ae38-4fd0-baef-ce74695fab99', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424c6a24-6d93-4d61-a72d-f82e1b05a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424c6a24-6d93-4d61-a72d-f82e1b05a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a11bf25-425b-4b33-a502-b61ace835498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume 0a4d378c-ae38-4fd0-baef-ce74695fab99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4d378c-ae38-4fd0-baef-ce74695fab99', 'volume_size': 1} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:25 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:25 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (ce6f987c-85c2-4c64-a213-e648ec5f54c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b34f73-a04d-42d9-a726-3091ca86b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b34f73-a04d-42d9-a726-3091ca86b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1350094627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5863be7e-5818-4608-ae57-3a2049711993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:25Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0073e375-7977-46ed-a5da-ab11000312bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0073e375-7977-46ed-a5da-ab11000312bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b85757-8b7b-476b-bf9f-732c33f8a79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b85757-8b7b-476b-bf9f-732c33f8a79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5863be7e-5818-4608-ae57-3a2049711993', 'volume_name': 'volume-5863be7e-5818-4608-ae57-3a2049711993', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08964fdf-7751-4834-a183-29f8d08108c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08964fdf-7751-4834-a183-29f8d08108c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28d18e1-c553-441d-bc34-da29f8ed09e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume 5863be7e-5818-4608-ae57-3a2049711993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5863be7e-5818-4608-ae57-3a2049711993', 'volume_size': 1} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (100cf437-1fb9-477b-b44c-147d9eb5f3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3781c50-bc35-4cc4-ae8e-232a40122955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3781c50-bc35-4cc4-ae8e-232a40122955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357236073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186f4517-8b4b-4a5f-add0-8fbee8d6da75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:26Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120dc045-b64c-4d84-97d2-a97e4747b11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120dc045-b64c-4d84-97d2-a97e4747b11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e61fb18-25da-4197-9309-66a815d24fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e61fb18-25da-4197-9309-66a815d24fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186f4517-8b4b-4a5f-add0-8fbee8d6da75', 'volume_name': 'volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475d80e7-d4b7-4512-937d-a57a2471342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475d80e7-d4b7-4512-937d-a57a2471342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad59ba8-15b9-49ed-bf23-5e8c23bec333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:25 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume 186f4517-8b4b-4a5f-add0-8fbee8d6da75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75', 'volume_size': 1} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-7c662ea1-b3ea-4ace-8f10-193d719da06e-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-7c662ea1-b3ea-4ace-8f10-193d719da06e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-quobyte-7c662ea1-b3ea-4ace-8f10-193d719da06e" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-7c662ea1-b3ea-4ace-8f10-193d719da06e" acquired by "delete_volume" :: waited 0.025s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c94ca5-15af-47f4-9279-e8ab8581fbcf]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:25 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992322fc-644c-4a41-90cf-639454b664eb -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9" returned: 0 in 0.738s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:25 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:25 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 is being set with open permissions: ugo+rw Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.660s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:25 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 Apr 09 17:00:25 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:25 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Deleted volume successfully. Apr 09 17:00:25 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-2766e05d-1ca9-4ca3-8c04-b07d5deee884 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-3d62898a-d14d-4d5b-893d-3fe7facccc21-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:25 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e Apr 09 17:00:25 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:26 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9" returned: 0 in 0.492s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:26 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.info Apr 09 17:00:26 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:26 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e" returned: 0 in 0.599s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:26 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e Apr 09 17:00:26 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:26 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.info" returned: 0 in 0.485s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:26 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.info is being set with open permissions: ugo+rw Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:26 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.info Apr 09 17:00:26 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:26 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7c662ea1-b3ea-4ace-8f10-193d719da06e" returned: 0 in 0.456s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-7c662ea1-b3ea-4ace-8f10-193d719da06e" released by "delete_volume" :: held 1.078s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Created reservations ['9ad0c64a-bfec-4797-8323-5e7f8f8e3cf8', '5801699d-add5-4f57-b2a2-c9ba1f7b2c49', 'cfec268c-3ce1-4ea5-b83b-aa66054659c5', '4c574696-1977-4962-9dcc-b1185b73a664'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:26 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:26 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:26 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:27 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.info" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.711s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.497s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-905372400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6e3b66-610e-4581-8bba-9fd3ac3bd052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:25Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Creating volume 5c6e3b66-610e-4581-8bba-9fd3ac3bd052 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:27 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-55391b78-c718-446f-9b07-35e8cc4e2926 tempest-VolumeDependencyTests-1005108956 None] Create snapshot completed successfully Apr 09 17:00:27 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 1073741824 Apr 09 17:00:27 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:27 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:27 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Deleted volume successfully. Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ae35bba3-169f-4c85-ae67-7f3af6840f61 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-7c662ea1-b3ea-4ace-8f10-193d719da06e-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Flow 'volume_create_manager' (7dfd7f07-d5af-4ba4-b685-f98649db087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c6a5c-2ad7-4036-b886-f73383903653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c6a5c-2ad7-4036-b886-f73383903653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1763919973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d526a831-493c-4382-8511-c79a144a1014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4e24f44f554a88acdffe585cc17db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36f94f95-68d7-4949-a9ad-47e062be41c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:28Z,use_quota=True,user_id='e276ea0d18034c469af0b8b7eb3a72b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af023a74-da2d-4258-9a41-d5fdc68d476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af023a74-da2d-4258-9a41-d5fdc68d476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434fc7e7-87f2-44a1-9987-0819c1d47f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434fc7e7-87f2-44a1-9987-0819c1d47f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd526a831-493c-4382-8511-c79a144a1014', 'volume_name': 'volume-d526a831-493c-4382-8511-c79a144a1014', 'volume_size': 1, 'snapshot_id': '36f94f95-68d7-4949-a9ad-47e062be41c9'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bb238f-998c-43b0-ba34-32b41f6dfb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bb238f-998c-43b0-ba34-32b41f6dfb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:27 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfafe4d-c634-413c-bfe0-82656a513079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:27 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Volume d526a831-493c-4382-8511-c79a144a1014: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d526a831-493c-4382-8511-c79a144a1014', 'volume_size': 1, 'snapshot_id': '36f94f95-68d7-4949-a9ad-47e062be41c9'} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-d9d11411-cb86-4999-b256-e096099f1722-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 1073741824" returned: 0 in 0.676s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-d9d11411-cb86-4999-b256-e096099f1722-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:27 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:28 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 Apr 09 17:00:28 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-quobyte-d9d11411-cb86-4999-b256-e096099f1722" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-d9d11411-cb86-4999-b256-e096099f1722" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c04b0-2d65-4862-8750-1bd694b57d99]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:28 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 Apr 09 17:00:28 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:28 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052" returned: 0 in 0.409s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.388s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-393562935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c14b9e6-3683-43e0-aff1-36c81765e893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:25Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Creating volume 3c14b9e6-3683-43e0-aff1-36c81765e893 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:28 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b600118f-3a67-4655-bb47-cf0ff73b1fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be62ff5a-124d-45e7-8aaa-e1ba69bef8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:28 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 1073741824 Apr 09 17:00:28 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:28 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 (5c6e3b66-610e-4581-8bba-9fd3ac3bd052): created successfully Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be62ff5a-124d-45e7-8aaa-e1ba69bef8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (1eac18aa-f695-41b5-bf98-1b019234565f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:28 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a557354f-2041-437f-8b65-b4c8be78ea46 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created volume successfully. Apr 09 17:00:28 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722" returned: 0 in 0.518s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:28 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:28 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722 Apr 09 17:00:28 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:29 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 1073741824" returned: 0 in 0.657s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:29 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d9d11411-cb86-4999-b256-e096099f1722" returned: 0 in 0.541s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-d9d11411-cb86-4999-b256-e096099f1722" released by "delete_volume" :: held 1.086s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:29 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 Apr 09 17:00:29 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Created reservations ['035dc1f7-0671-487e-a998-dff15540922a', '1d9f342b-27e4-4495-9d36-8e9ea3aed923', 'da8f5bf4-41c1-4c7b-85e8-90c89e919587', '1242dfb7-009b-4fa3-a2d2-6f5d63447595'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:29 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:29 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:29 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893" returned: 0 in 0.474s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.454s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624342756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4d378c-ae38-4fd0-baef-ce74695fab99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:25Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Creating volume 0a4d378c-ae38-4fd0-baef-ce74695fab99 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:29 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ff07f3-0e2a-407e-8486-0d10f7d8ba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c14b9e6-3683-43e0-aff1-36c81765e893', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ad31ef-03f1-4905-99ea-ae42903c09a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:29 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume volume-3c14b9e6-3683-43e0-aff1-36c81765e893 (3c14b9e6-3683-43e0-aff1-36c81765e893): created successfully Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ad31ef-03f1-4905-99ea-ae42903c09a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:29 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 1073741824 Apr 09 17:00:29 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (3fd45140-63a5-44b7-8386-0bc1c930d55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:29 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.425s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f7cb193d-a366-4b68-962d-976ce169f9a4 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created volume successfully. Apr 09 17:00:29 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Deleted volume successfully. Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Flow 'volume_create_manager' (fe7e6e7b-5c95-4c76-adb6-e11417ebe80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10202a26-f717-42df-b1ed-b461905ff63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10202a26-f717-42df-b1ed-b461905ff63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-711143488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7856103d-d048-43e7-8b8b-d01385c2a54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d9fe8308744380a2b2ff76f6c5ca8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:30Z,use_quota=True,user_id='7d68a7c9fe4942e48f947134d6855cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed5d416-f8c8-420c-b029-ac79bc799017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed5d416-f8c8-420c-b029-ac79bc799017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a5e5f4-0fcc-4fda-8ab2-c020c8d2a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a5e5f4-0fcc-4fda-8ab2-c020c8d2a190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7856103d-d048-43e7-8b8b-d01385c2a54d', 'volume_name': 'volume-7856103d-d048-43e7-8b8b-d01385c2a54d', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd523e1f-a01e-4c0f-8882-301096ce8eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd523e1f-a01e-4c0f-8882-301096ce8eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b199e8-f8c3-4ba1-a0d8-afd6899e4c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:29 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Volume 7856103d-d048-43e7-8b8b-d01385c2a54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7856103d-d048-43e7-8b8b-d01385c2a54d', 'volume_size': 1} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:29 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-64957a8a-011a-4f59-bb6e-9260a6d82621 tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-d9d11411-cb86-4999-b256-e096099f1722-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-5423aeee-c6cd-481e-a897-cf449159c57e-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-5423aeee-c6cd-481e-a897-cf449159c57e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:30 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 1073741824" returned: 0 in 0.542s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "cinder-quobyte-5423aeee-c6cd-481e-a897-cf449159c57e" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-5423aeee-c6cd-481e-a897-cf449159c57e" acquired by "delete_volume" :: waited 0.022s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:30 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 Apr 09 17:00:30 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b44da64-1432-4aa1-a14a-717ed1d32bd3]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:30 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e Apr 09 17:00:30 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:30 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99" returned: 0 in 0.395s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.129s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1350094627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5863be7e-5818-4608-ae57-3a2049711993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:25Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Creating volume 5863be7e-5818-4608-ae57-3a2049711993 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:30 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a11bf25-425b-4b33-a502-b61ace835498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4d378c-ae38-4fd0-baef-ce74695fab99', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0783e8fe-943a-487e-8a80-9a1be33e3f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:30 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 1073741824 Apr 09 17:00:30 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:30 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 (0a4d378c-ae38-4fd0-baef-ce74695fab99): created successfully Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0783e8fe-943a-487e-8a80-9a1be33e3f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (690b08b3-767e-44ad-8c43-e44c894a14ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:30 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ef615395-0a82-48e1-844b-6c532c0ba7b9 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created volume successfully. Apr 09 17:00:30 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e" returned: 0 in 0.477s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:30 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:30 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e Apr 09 17:00:30 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:31 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 1073741824" returned: 0 in 0.500s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:31 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5423aeee-c6cd-481e-a897-cf449159c57e" returned: 0 in 0.428s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-quobyte-5423aeee-c6cd-481e-a897-cf449159c57e" released by "delete_volume" :: held 0.930s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:31 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 Apr 09 17:00:31 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Created reservations ['44c7c06f-233d-4f9e-9529-1d0ad27678b1', '55e81dad-6c7d-4add-8449-85373f1dd778', '9e36e839-ee2d-4c1c-bf53-92d8237c28f3', 'c29e55d4-9f4e-41bd-b9d3-7cccf061ba7f'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:31 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:31 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:31 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993" returned: 0 in 0.413s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.890s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357236073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186f4517-8b4b-4a5f-add0-8fbee8d6da75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a74ae4b96044df83e67ec4222fd0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:26Z,use_quota=True,user_id='a7eeea5670b0497a96dd4d8f71a2eeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Creating volume 186f4517-8b4b-4a5f-add0-8fbee8d6da75 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:31 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28d18e1-c553-441d-bc34-da29f8ed09e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5863be7e-5818-4608-ae57-3a2049711993', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:31 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 1073741824 Apr 09 17:00:31 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ef817c-aaa9-4c46-b268-8538421f292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:31 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume volume-5863be7e-5818-4608-ae57-3a2049711993 (5863be7e-5818-4608-ae57-3a2049711993): created successfully Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ef817c-aaa9-4c46-b268-8538421f292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (ce6f987c-85c2-4c64-a213-e648ec5f54c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:31 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-98f8cdc6-fd1a-4d24-962c-8d4dbae5204f tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created volume successfully. Apr 09 17:00:31 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.465s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:31 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Deleted volume successfully. Apr 09 17:00:31 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-516e308a-15dc-4d49-bc35-627cda44829e tempest-CreateVolumesFromImageTest-1474326306 None] Lock "cinder-5423aeee-c6cd-481e-a897-cf449159c57e-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:32 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 1073741824" returned: 0 in 0.590s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:32 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 Apr 09 17:00:32 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:32 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75" returned: 0 in 0.454s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.620s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-36f94f95-68d7-4949-a9ad-47e062be41c9-d526a831-493c-4382-8511-c79a144a1014" by "_create_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad59ba8-15b9-49ed-bf23-5e8c23bec333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372b3040-9144-4c1b-8242-4ce8a4331053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-36f94f95-68d7-4949-a9ad-47e062be41c9-d526a831-493c-4382-8511-c79a144a1014" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Creating volume d526a831-493c-4382-8511-c79a144a1014 from snapshot 36f94f95-68d7-4949-a9ad-47e062be41c9 {{(pid=82139) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-d526a831-493c-4382-8511-c79a144a1014" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:32 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Volume volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 (186f4517-8b4b-4a5f-add0-8fbee8d6da75): created successfully Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372b3040-9144-4c1b-8242-4ce8a4331053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Flow 'volume_create_manager' (100cf437-1fb9-477b-b44c-147d9eb5f3b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-d526a831-493c-4382-8511-c79a144a1014" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] snapshot: 36f94f95-68d7-4949-a9ad-47e062be41c9, volume: d526a831-493c-4382-8511-c79a144a1014, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:00:32 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6bb35f0e-bfe2-40cd-b375-93bfc4764bbb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created volume successfully. Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c816277-07d9-4b6f-b8e5-c2c07b309268]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:32 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 Apr 09 17:00:32 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (4c6dd84f-90b0-485e-ab30-93e5de82220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038e8109-5fd2-4cda-9e7d-79495df708d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038e8109-5fd2-4cda-9e7d-79495df708d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926368695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:33Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1375c888-dc7e-4ed8-a2fa-4b157778b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1375c888-dc7e-4ed8-a2fa-4b157778b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cb3072-6a72-44f3-b59e-5749a1b56192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cb3072-6a72-44f3-b59e-5749a1b56192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f', 'volume_name': 'volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ba155f-b4a1-4943-975c-6917a72a35a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ba155f-b4a1-4943-975c-6917a72a35a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf133fb-4a83-4def-a505-1cd0ab0385a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:32 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f', 'volume_size': 1} Apr 09 17:00:32 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-186f4517-8b4b-4a5f-add0-8fbee8d6da75-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-186f4517-8b4b-4a5f-add0-8fbee8d6da75-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-quobyte-186f4517-8b4b-4a5f-add0-8fbee8d6da75" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-186f4517-8b4b-4a5f-add0-8fbee8d6da75" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[906946fc-1dd2-4bce-b4eb-2c66e1a14a0b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:33 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9" returned: 0 in 0.585s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-992322fc-644c-4a41-90cf-639454b664eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dfe3b5-c1e4-4609-acbe-c7674e8da0e7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:33 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 Apr 09 17:00:33 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:33 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb Apr 09 17:00:33 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:33 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75" returned: 0 in 0.473s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:33 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75 Apr 09 17:00:33 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:33 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:00:33 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:33 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 Apr 09 17:00:33 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:34 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-186f4517-8b4b-4a5f-add0-8fbee8d6da75" returned: 0 in 0.458s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-186f4517-8b4b-4a5f-add0-8fbee8d6da75" released by "delete_volume" :: held 0.964s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created reservations ['a9323dbf-ca28-45cc-9cd6-25ff9d7595ac', 'a0fbde84-c2d8-442f-8cd2-61d8cc0994f5', 'e625698f-bdc1-40f4-845a-06e18ce359a1', '60086743-b6f8-46df-97fe-23f5bfb58e22'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:34 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:34 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-5863be7e-5818-4608-ae57-3a2049711993-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-5863be7e-5818-4608-ae57-3a2049711993-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-quobyte-5863be7e-5818-4608-ae57-3a2049711993" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-5863be7e-5818-4608-ae57-3a2049711993" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dbcedf-b475-4215-a6fa-2fe74953bfd9]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:34 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:35 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 Apr 09 17:00:35 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:35 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 1.340s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:35 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:35 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Deleted volume successfully. Apr 09 17:00:35 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-5eda5b19-2904-4cd6-9b3b-b1212ad2a990 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-186f4517-8b4b-4a5f-add0-8fbee8d6da75-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:35 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014" returned: 0 in 2.251s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:35 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a1fbf-e17d-4b2a-8e0e-cda7f9e0b453]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:35 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:36 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb Apr 09 17:00:36 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:36 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993" returned: 0 in 1.337s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:36 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993 Apr 09 17:00:36 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:36 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5863be7e-5818-4608-ae57-3a2049711993" returned: 0 in 0.419s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-5863be7e-5818-4608-ae57-3a2049711993" released by "delete_volume" :: held 1.815s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created reservations ['406cc915-28bd-48b3-8219-1a4f82fc0926', '0219dcaf-7b1d-4deb-8ab3-4300288dcd4a', '3005b692-7f2f-44e5-81fe-42f57c6b735d', '9ce360ed-7210-4149-aca1-e5479367b4ff'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:36 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb" returned: 0 in 0.663s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:00:36 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Converted 1024.00 MB image at 454.79 MB/s Apr 09 17:00:36 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 is being set with open permissions: ugo+rw Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:36 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:36 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:36 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 Apr 09 17:00:36 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-0a4d378c-ae38-4fd0-baef-ce74695fab99-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-0a4d378c-ae38-4fd0-baef-ce74695fab99-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:36 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-quobyte-0a4d378c-ae38-4fd0-baef-ce74695fab99" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-0a4d378c-ae38-4fd0-baef-ce74695fab99" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[2289ce4b-e8bc-4b18-8ad9-265acdf0b2d7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:37 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.448s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:37 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Deleted volume successfully. Apr 09 17:00:37 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:37 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 Apr 09 17:00:37 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-ed28756c-9f1f-4064-bb42-43568ab2cb6c tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-5863be7e-5818-4608-ae57-3a2049711993-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014" returned: 0 in 0.465s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-d526a831-493c-4382-8511-c79a144a1014" released by "_copy_volume_from_snapshot" :: held 4.489s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-36f94f95-68d7-4949-a9ad-47e062be41c9-d526a831-493c-4382-8511-c79a144a1014" released by "_create_volume_from_snapshot" :: held 4.517s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.536s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.388s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-711143488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7856103d-d048-43e7-8b8b-d01385c2a54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d9fe8308744380a2b2ff76f6c5ca8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:30Z,use_quota=True,user_id='7d68a7c9fe4942e48f947134d6855cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Creating volume 7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:37 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:37 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d 1073741824 Apr 09 17:00:37 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfafe4d-c634-413c-bfe0-82656a513079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d526a831-493c-4382-8511-c79a144a1014', 'volume_size': 1, 'snapshot_id': '36f94f95-68d7-4949-a9ad-47e062be41c9'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069ca525-3e0f-46da-94e3-519b9e580746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:37 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Volume volume-d526a831-493c-4382-8511-c79a144a1014 (d526a831-493c-4382-8511-c79a144a1014): created successfully Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069ca525-3e0f-46da-94e3-519b9e580746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Flow 'volume_create_manager' (7dfd7f07-d5af-4ba4-b685-f98649db087a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:37 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-b606e46e-2ead-41cc-b478-984a1d2117e6 tempest-VolumeDependencyTests-1005108956 None] Created volume successfully. Apr 09 17:00:37 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99" returned: 0 in 0.528s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:37 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99 Apr 09 17:00:37 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:37 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d 1073741824" returned: 0 in 0.474s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-36f94f95-68d7-4949-a9ad-47e062be41c9-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-36f94f95-68d7-4949-a9ad-47e062be41c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-992322fc-644c-4a41-90cf-639454b664eb" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-992322fc-644c-4a41-90cf-639454b664eb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-36f94f95-68d7-4949-a9ad-47e062be41c9" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:37 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d Apr 09 17:00:37 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-36f94f95-68d7-4949-a9ad-47e062be41c9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Deleting offline snapshot 36f94f95-68d7-4949-a9ad-47e062be41c9 of volume 992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] snapshot_file for this snap is: volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf00afcb-9d1c-45c4-8289-60f37eae1067]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:37 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 Apr 09 17:00:37 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:37 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:37 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-0a4d378c-ae38-4fd0-baef-ce74695fab99" returned: 0 in 0.441s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-0a4d378c-ae38-4fd0-baef-ce74695fab99" released by "delete_volume" :: held 0.993s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created reservations ['8f114307-9f15-4fb8-8bed-363adbc61741', 'f7f08a12-bc58-4467-8c76-09fbc71d4cdb', 'f2455f6f-b928-4a0a-abee-d6fee00f9e88', 'cf1de38e-cc1b-434e-abd9-ce87c7b85c06'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:38 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d" returned: 0 in 0.431s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:38 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:38 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.153s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926368695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:33Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Creating volume bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:38 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b199e8-f8c3-4ba1-a0d8-afd6899e4c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7856103d-d048-43e7-8b8b-d01385c2a54d', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6464ba-dcc4-4994-858f-ed2580063abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:38 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f 1073741824 Apr 09 17:00:38 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:38 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Volume volume-7856103d-d048-43e7-8b8b-d01385c2a54d (7856103d-d048-43e7-8b8b-d01385c2a54d): created successfully Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6464ba-dcc4-4994-858f-ed2580063abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Flow 'volume_create_manager' (fe7e6e7b-5c95-4c76-adb6-e11417ebe80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:38 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-473fc65d-b532-4373-95cf-7d744d9c14b9 tempest-SnapshotDependencyTests-780334479 None] Created volume successfully. Apr 09 17:00:38 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9" returned: 0 in 0.513s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-992322fc-644c-4a41-90cf-639454b664eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dbae2d-9d5d-4334-8c3b-daf72ee420ea]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:38 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb Apr 09 17:00:38 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:38 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.425s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:38 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Deleted volume successfully. Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-f637a053-68ab-4eff-8cf0-f61ad78e1602 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-0a4d378c-ae38-4fd0-baef-ce74695fab99-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:38 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f 1073741824" returned: 0 in 0.509s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:38 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f Apr 09 17:00:38 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:38 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb" returned: 0 in 0.493s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:38 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:38 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 Apr 09 17:00:38 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:39 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f" returned: 0 in 0.404s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf133fb-4a83-4def-a505-1cd0ab0385a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a41a53d-264a-468f-950d-e2e5730cde42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f (bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f): created successfully Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a41a53d-264a-468f-950d-e2e5730cde42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (4c6dd84f-90b0-485e-ab30-93e5de82220b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:39 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-be69cd69-1284-4ea0-832f-77d859f1f09c tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created volume successfully. Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-3c14b9e6-3683-43e0-aff1-36c81765e893-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-3c14b9e6-3683-43e0-aff1-36c81765e893-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-quobyte-3c14b9e6-3683-43e0-aff1-36c81765e893" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-3c14b9e6-3683-43e0-aff1-36c81765e893" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9d11b-4e9c-4860-9cb1-2ff099bfc706]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:39 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9" returned: 0 in 0.506s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:39 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9 Apr 09 17:00:39 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:39 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 Apr 09 17:00:39 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Creating offline snapshot b16e0005-fb4d-4479-81c6-174b36a39a1a of volume 7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f3b739-d454-4564-9f78-030ea5deaeb0]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:39 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d Apr 09 17:00:39 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (5bba7950-f179-4012-9b59-7ae90db669bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f81c2a2-8ad2-4117-917c-d65f55195931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f81c2a2-8ad2-4117-917c-d65f55195931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893466062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cb0b1a-99b6-484e-9ecd-4cc991469df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beda4a32-eec6-4ad9-aa9d-55a5011ae012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beda4a32-eec6-4ad9-aa9d-55a5011ae012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa23dcc6-4f14-455c-afb7-cd680afd289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa23dcc6-4f14-455c-afb7-cd680afd289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1cb0b1a-99b6-484e-9ecd-4cc991469df8', 'volume_name': 'volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765eb972-8aa3-47fc-bd06-aac07472cf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765eb972-8aa3-47fc-bd06-aac07472cf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f40572-3e88-4782-9d6f-7ef2e067a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume b1cb0b1a-99b6-484e-9ecd-4cc991469df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8', 'volume_size': 1} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893" returned: 0 in 0.547s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:39 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893 Apr 09 17:00:39 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:39 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb.36f94f95-68d7-4949-a9ad-47e062be41c9" returned: 0 in 0.629s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-36f94f95-68d7-4949-a9ad-47e062be41c9" released by "_delete_snapshot" :: held 2.193s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-992322fc-644c-4a41-90cf-639454b664eb" released by "delete_snapshot" :: held 2.211s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (dcdeb60f-b990-480d-80f8-1aa445f5d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ce13e0-39cf-4a83-afd2-d8abc0bdd1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ce13e0-39cf-4a83-afd2-d8abc0bdd1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-876368796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb82d09-dd71-4227-8717-b6ebb094ee5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7e3b3d-4e5b-4638-a0ce-2faa9e3bf966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7e3b3d-4e5b-4638-a0ce-2faa9e3bf966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbc8f15-b135-423b-af44-dfdb5cb0f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbc8f15-b135-423b-af44-dfdb5cb0f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb82d09-dd71-4227-8717-b6ebb094ee5c', 'volume_name': 'volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4871ad05-e942-4454-9fb1-0ae2e05214ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4871ad05-e942-4454-9fb1-0ae2e05214ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d496718f-3173-4582-98e5-bf27b84564c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:39 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume 8bb82d09-dd71-4227-8717-b6ebb094ee5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c', 'volume_size': 1} Apr 09 17:00:39 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Created reservations ['e61bbe7c-88dd-44f6-9862-83b188d90d19', '2ab536b2-4be2-47e8-9ccf-a583db05da94', 'fb7b597b-bb49-4ce1-a633-c4caad29554f', '05f75c3f-f2a9-4fbb-b5c0-9d6439179fbb'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:40 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Delete snapshot completed successfully. Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a8005c9a-226b-4ed6-955d-1b4fa01f323b tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-36f94f95-68d7-4949-a9ad-47e062be41c9-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:40 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (17e5449a-52bd-4003-bacf-6620e6ae16c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b860dfb-be7d-4964-bef3-37ca2486467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b860dfb-be7d-4964-bef3-37ca2486467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954882097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0cd2e7-a746-4498-8992-dccb49d1b6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad852296-4c96-41df-80dd-68106a59382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad852296-4c96-41df-80dd-68106a59382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e9912a-403f-4f3b-97f5-294f8bf3d7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e9912a-403f-4f3b-97f5-294f8bf3d7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0cd2e7-a746-4498-8992-dccb49d1b6d6', 'volume_name': 'volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d581b02-a4b9-4e06-b5a9-cd93c8d20a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d581b02-a4b9-4e06-b5a9-cd93c8d20a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda8d006-9093-4e27-b661-9a1833a8dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume ff0cd2e7-a746-4498-8992-dccb49d1b6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6', 'volume_size': 1} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d" returned: 0 in 0.725s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:40 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a 1G Apr 09 17:00:40 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:40 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c14b9e6-3683-43e0-aff1-36c81765e893" returned: 0 in 0.554s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-3c14b9e6-3683-43e0-aff1-36c81765e893" released by "delete_volume" :: held 1.122s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (4e0468ea-d71e-4042-941c-3e66f896edd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c788af-3d2f-46ee-b1bb-a04c52489aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c788af-3d2f-46ee-b1bb-a04c52489aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-56228928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1831cc-0b23-40b4-bdd0-d8274b0f2389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f58106f-4776-427c-bd6b-7bdb0326b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f58106f-4776-427c-bd6b-7bdb0326b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0b6334-f5e7-4ca1-bac2-c00b5c906bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0b6334-f5e7-4ca1-bac2-c00b5c906bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff1831cc-0b23-40b4-bdd0-d8274b0f2389', 'volume_name': 'volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca351ff4-0f26-40ad-9a85-f7a911d0c337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca351ff4-0f26-40ad-9a85-f7a911d0c337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5220bf93-1e9a-449a-8787-04b5832d3ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume ff1831cc-0b23-40b4-bdd0-d8274b0f2389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389', 'volume_size': 1} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created reservations ['b5ef2983-51e3-4553-89be-9e262be30038', '5af93160-a012-4ee5-b891-ce992b302ec3', '4a30270f-491f-4018-b39a-426dcc5c4fec', 'd96e58e5-11b4-4ccc-83c2-58fb81b600b7'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:40 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:40 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (70bd6fc0-14c7-4997-b03f-e04e9eb8b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0d5045-dfe0-41f5-b7d0-41fb9db67d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0d5045-dfe0-41f5-b7d0-41fb9db67d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-971726073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bed7f20-0d60-43c9-8641-b432e0cb4308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04166d6-65f6-4bcf-ae0d-aee698d3594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04166d6-65f6-4bcf-ae0d-aee698d3594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723404b9-7e40-41e1-8d05-1ef379731498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723404b9-7e40-41e1-8d05-1ef379731498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bed7f20-0d60-43c9-8641-b432e0cb4308', 'volume_name': 'volume-3bed7f20-0d60-43c9-8641-b432e0cb4308', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bac6c01-d9cf-421e-a03f-13a6521a9e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bac6c01-d9cf-421e-a03f-13a6521a9e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e013e8f-5767-4382-be3d-6b6cfcfbe089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:40 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume 3bed7f20-0d60-43c9-8641-b432e0cb4308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bed7f20-0d60-43c9-8641-b432e0cb4308', 'volume_size': 1} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:40 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a 1G" returned: 0 in 0.559s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7856103d-d048-43e7-8b8b-d01385c2a54d -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:40 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7856103d-d048-43e7-8b8b-d01385c2a54d -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a Apr 09 17:00:40 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-992322fc-644c-4a41-90cf-639454b664eb-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-992322fc-644c-4a41-90cf-639454b664eb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-992322fc-644c-4a41-90cf-639454b664eb" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-992322fc-644c-4a41-90cf-639454b664eb" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d199b4a-c54b-4d8b-858a-fac5a41eda62]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:40 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb Apr 09 17:00:40 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:40 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:40 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Deleted volume successfully. Apr 09 17:00:40 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-dabd305e-3767-4d13-8e96-43240ebf74fb tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-3c14b9e6-3683-43e0-aff1-36c81765e893-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:41 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7856103d-d048-43e7-8b8b-d01385c2a54d -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a" returned: 0 in 0.476s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:41 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a is being set with open permissions: ugo+rw Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:41 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a Apr 09 17:00:41 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-5c6e3b66-610e-4581-8bba-9fd3ac3bd052-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-5c6e3b66-610e-4581-8bba-9fd3ac3bd052-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:41 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-quobyte-5c6e3b66-610e-4581-8bba-9fd3ac3bd052" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb" returned: 0 in 0.535s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-5c6e3b66-610e-4581-8bba-9fd3ac3bd052" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:41 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6e9490-73a8-4458-aa24-2e582bf8e3aa]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:41 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:41 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 Apr 09 17:00:41 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:41 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a" returned: 0 in 0.446s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:41 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.info Apr 09 17:00:41 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:41 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-992322fc-644c-4a41-90cf-639454b664eb" returned: 0 in 0.453s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-992322fc-644c-4a41-90cf-639454b664eb" released by "delete_volume" :: held 1.017s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Created reservations ['e84da7d3-0096-4c76-bf20-78a2cd01e5cf', '6580457b-9f7a-48e2-8eb8-9c3d3748a904', 'b31ed97c-bd3a-4d3e-8fed-0d82b908eb27', '5ddc6b64-927d-45d0-9930-278a9648d9d2'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:41 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052" returned: 0 in 0.542s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:41 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:41 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:41 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:41 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052 Apr 09 17:00:41 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:42 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.info" returned: 0 in 0.448s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:42 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.info is being set with open permissions: ugo+rw Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:42 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.info Apr 09 17:00:42 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:42 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.412s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:42 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Deleted volume successfully. Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a62bf65c-b9e1-4ade-a5c3-04b5fa3d832d tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-992322fc-644c-4a41-90cf-639454b664eb-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:42 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5c6e3b66-610e-4581-8bba-9fd3ac3bd052" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-5c6e3b66-610e-4581-8bba-9fd3ac3bd052" released by "delete_volume" :: held 0.994s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created reservations ['894e051f-015a-42aa-b6a1-1c94675af825', 'fd0d4c39-1d22-4938-9a66-563a779ca607', '9e7083b2-699d-4c47-8ff9-09d29239d6c1', '3a125b3a-65af-478b-a4c3-32ffa60b85c5'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:42 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:42 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:42 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.info" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.809s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893466062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cb0b1a-99b6-484e-9ecd-4cc991469df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Creating volume b1cb0b1a-99b6-484e-9ecd-4cc991469df8 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:42 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:42 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 1073741824 Apr 09 17:00:42 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:42 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-2c20527e-5896-43ad-9e51-d21faa90eae8 tempest-SnapshotDependencyTests-780334479 None] Create snapshot completed successfully Apr 09 17:00:42 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.409s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:42 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Deleted volume successfully. Apr 09 17:00:42 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-6ef34995-8bf0-43e2-bdf4-e82acdeabeea tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-5c6e3b66-610e-4581-8bba-9fd3ac3bd052-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:43 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 1073741824" returned: 0 in 0.511s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:43 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 Apr 09 17:00:43 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Flow 'volume_create_manager' (81c99ee7-c489-4c3a-adab-711a27884a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed377d4-df03-4ad5-a79e-60fc20a7740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed377d4-df03-4ad5-a79e-60fc20a7740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1670759699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2741b1ad-3a86-4aa2-be29-d4d83d7b027f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4e24f44f554a88acdffe585cc17db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:43Z,use_quota=True,user_id='e276ea0d18034c469af0b8b7eb3a72b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70ea6fc-b9c8-4578-973a-3d5731b8c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70ea6fc-b9c8-4578-973a-3d5731b8c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479dd28d-b926-4dde-9b34-23445b4b258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479dd28d-b926-4dde-9b34-23445b4b258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2741b1ad-3a86-4aa2-be29-d4d83d7b027f', 'volume_name': 'volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb782057-c9c3-4b36-9937-b12d625d3f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb782057-c9c3-4b36-9937-b12d625d3f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aea814d-f254-489f-8754-81b3350c83c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Volume 2741b1ad-3a86-4aa2-be29-d4d83d7b027f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f', 'volume_size': 1} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-451d5de2-d309-41e5-acfa-69348bea551b-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-451d5de2-d309-41e5-acfa-69348bea551b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-quobyte-3c4a8abf-c87a-4668-bffe-189cc004a6a6" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-3c4a8abf-c87a-4668-bffe-189cc004a6a6" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-quobyte-451d5de2-d309-41e5-acfa-69348bea551b" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-451d5de2-d309-41e5-acfa-69348bea551b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Deleting offline snapshot 451d5de2-d309-41e5-acfa-69348bea551b of volume 3c4a8abf-c87a-4668-bffe-189cc004a6a6 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] snapshot_file for this snap is: volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:00:43 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8" returned: 0 in 0.451s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c49cc-30b1-4e14-9efe-58a7e3669b22]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.571s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-876368796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb82d09-dd71-4227-8717-b6ebb094ee5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Creating volume 8bb82d09-dd71-4227-8717-b6ebb094ee5c {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:43 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:43 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c 1073741824 Apr 09 17:00:43 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f40572-3e88-4782-9d6f-7ef2e067a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d951bf60-8c3f-4596-8888-a731b9356ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 (b1cb0b1a-99b6-484e-9ecd-4cc991469df8): created successfully Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d951bf60-8c3f-4596-8888-a731b9356ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (5bba7950-f179-4012-9b59-7ae90db669bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:43 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b Apr 09 17:00:43 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:43 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-54d954f9-b766-4b21-9fd3-a105d5f49dbe tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created volume successfully. Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Flow 'volume_create_manager' (7ddde716-585d-46bb-9013-c5be70b0f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fc2b4f-d4f5-4461-9d9f-2ecb426d6611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fc2b4f-d4f5-4461-9d9f-2ecb426d6611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e620c39-23bc-4222-bbfa-90b41717ee3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d9fe8308744380a2b2ff76f6c5ca8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b16e0005-fb4d-4479-81c6-174b36a39a1a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:44Z,use_quota=True,user_id='7d68a7c9fe4942e48f947134d6855cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c990b942-24de-45ba-92a7-d1bc7af03dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c990b942-24de-45ba-92a7-d1bc7af03dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6c73b3-b7d7-4b3e-a7a9-b6604e895d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6c73b3-b7d7-4b3e-a7a9-b6604e895d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e620c39-23bc-4222-bbfa-90b41717ee3d', 'volume_name': 'volume-8e620c39-23bc-4222-bbfa-90b41717ee3d', 'volume_size': 1, 'snapshot_id': 'b16e0005-fb4d-4479-81c6-174b36a39a1a'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9144941d-ef48-42c3-81cc-4e9dfb740ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9144941d-ef48-42c3-81cc-4e9dfb740ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe1c6ef-12e3-405e-9d93-d4f5295d136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:43 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Volume 8e620c39-23bc-4222-bbfa-90b41717ee3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e620c39-23bc-4222-bbfa-90b41717ee3d', 'volume_size': 1, 'snapshot_id': 'b16e0005-fb4d-4479-81c6-174b36a39a1a'} Apr 09 17:00:43 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:44 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c 1073741824" returned: 0 in 0.507s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:44 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c Apr 09 17:00:44 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:44 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b" returned: 0 in 0.577s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a787fa-6833-4276-8fb7-d15c084a8d75]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:44 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 Apr 09 17:00:44 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:44 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c" returned: 0 in 0.398s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954882097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0cd2e7-a746-4498-8992-dccb49d1b6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Creating volume ff0cd2e7-a746-4498-8992-dccb49d1b6d6 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:44 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d496718f-3173-4582-98e5-bf27b84564c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e853ff87-9b21-4a5f-a95b-5b9d13738732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:44 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 1073741824 Apr 09 17:00:44 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:44 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c (8bb82d09-dd71-4227-8717-b6ebb094ee5c): created successfully Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e853ff87-9b21-4a5f-a95b-5b9d13738732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (dcdeb60f-b990-480d-80f8-1aa445f5d022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:44 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a98f1e5d-87e8-4aef-8550-9a393306db6b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created volume successfully. Apr 09 17:00:44 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6" returned: 0 in 0.475s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:44 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:44 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b Apr 09 17:00:44 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:45 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 1073741824" returned: 0 in 0.543s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:45 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 Apr 09 17:00:45 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:45 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b" returned: 0 in 0.482s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:45 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b Apr 09 17:00:45 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:45 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6" returned: 0 in 0.414s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.096s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-56228928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1831cc-0b23-40b4-bdd0-d8274b0f2389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Creating volume ff1831cc-0b23-40b4-bdd0-d8274b0f2389 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:45 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda8d006-9093-4e27-b661-9a1833a8dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0af7cf8-7e3f-4728-82e4-0feb84dc6c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:45 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 1073741824 Apr 09 17:00:45 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:45 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 (ff0cd2e7-a746-4498-8992-dccb49d1b6d6): created successfully Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0af7cf8-7e3f-4728-82e4-0feb84dc6c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (17e5449a-52bd-4003-bacf-6620e6ae16c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:45 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-afdc3d6d-8e7c-4b06-8e3d-dab2a522b910 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created volume successfully. Apr 09 17:00:45 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6.451d5de2-d309-41e5-acfa-69348bea551b" returned: 0 in 0.417s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-451d5de2-d309-41e5-acfa-69348bea551b" released by "_delete_snapshot" :: held 2.032s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-3c4a8abf-c87a-4668-bffe-189cc004a6a6" released by "delete_snapshot" :: held 2.052s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created reservations ['e8e6abe2-b55d-48dd-ac9d-222fc46abbc9', '6b411e46-e509-495c-8dd5-135d772fbe0a', 'ea9cfc39-ddc4-47ed-b039-bb084f8e3021', '1cda6dc8-ef6e-46c3-a2b0-1e307112d1ae'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:45 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Delete snapshot completed successfully. Apr 09 17:00:45 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3b331168-5e7a-4afb-96fd-02d6e0007e38 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-451d5de2-d309-41e5-acfa-69348bea551b-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:46 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 1073741824" returned: 0 in 0.508s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:46 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 Apr 09 17:00:46 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:46 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389" returned: 0 in 0.418s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.869s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-971726073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bed7f20-0d60-43c9-8641-b432e0cb4308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac692ce43fd74cc5a804504ddba5140e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:40Z,use_quota=True,user_id='1a355d91b1e345ef9ec058f8ea4fa4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Creating volume 3bed7f20-0d60-43c9-8641-b432e0cb4308 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:46 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5220bf93-1e9a-449a-8787-04b5832d3ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3964b5f-93df-4fde-ad30-61707dee3632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:46 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 1073741824 Apr 09 17:00:46 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:46 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 (ff1831cc-0b23-40b4-bdd0-d8274b0f2389): created successfully Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3964b5f-93df-4fde-ad30-61707dee3632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (4e0468ea-d71e-4042-941c-3e66f896edd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:46 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-44428b2d-5f22-466f-814d-57975728b0f4 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created volume successfully. Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-3c4a8abf-c87a-4668-bffe-189cc004a6a6-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-3c4a8abf-c87a-4668-bffe-189cc004a6a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "cinder-quobyte-3c4a8abf-c87a-4668-bffe-189cc004a6a6" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-3c4a8abf-c87a-4668-bffe-189cc004a6a6" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcfc84f-91bc-4006-b337-ee399d5ca0d6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:46 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 Apr 09 17:00:46 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:46 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 1073741824" returned: 0 in 0.509s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:46 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:47 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 Apr 09 17:00:47 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:47 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6" returned: 0 in 0.504s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:47 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6 Apr 09 17:00:47 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:47 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308" returned: 0 in 0.423s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.149s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1670759699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2741b1ad-3a86-4aa2-be29-d4d83d7b027f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4e24f44f554a88acdffe585cc17db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:43Z,use_quota=True,user_id='e276ea0d18034c469af0b8b7eb3a72b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Creating volume 2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:47 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e013e8f-5767-4382-be3d-6b6cfcfbe089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bed7f20-0d60-43c9-8641-b432e0cb4308', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed133793-856f-440e-8f6e-c8515d8a5611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:47 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f 1073741824 Apr 09 17:00:47 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:47 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Volume volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 (3bed7f20-0d60-43c9-8641-b432e0cb4308): created successfully Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed133793-856f-440e-8f6e-c8515d8a5611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Flow 'volume_create_manager' (70bd6fc0-14c7-4997-b03f-e04e9eb8b198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:47 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-0835159d-ed2d-4076-aea8-5fedb7413262 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created volume successfully. Apr 09 17:00:47 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3c4a8abf-c87a-4668-bffe-189cc004a6a6" returned: 0 in 0.400s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-quobyte-3c4a8abf-c87a-4668-bffe-189cc004a6a6" released by "delete_volume" :: held 0.932s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Created reservations ['47502e55-4543-4cdc-ac49-24dd57fa3507', 'bb42559f-4188-4b50-996a-c0338846e152', 'a89fc1c9-bf5c-4da6-a452-f65476e48c49', '10350f5f-8afb-4b7a-8fbb-8812cfbb7864'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:47 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:47 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:47 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f 1073741824" returned: 0 in 0.524s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:47 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:47 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f Apr 09 17:00:47 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-3bed7f20-0d60-43c9-8641-b432e0cb4308-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-3bed7f20-0d60-43c9-8641-b432e0cb4308-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-quobyte-3bed7f20-0d60-43c9-8641-b432e0cb4308" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-3bed7f20-0d60-43c9-8641-b432e0cb4308" acquired by "delete_volume" :: waited 0.014s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b03683d-9eb2-4403-a98d-08fd96f25987]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:48 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.562s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:48 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Deleted volume successfully. Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a9763502-97c5-4638-9d69-86a5259a8157 tempest-CreateVolumesFromSnapshotTest-1878695043 None] Lock "cinder-3c4a8abf-c87a-4668-bffe-189cc004a6a6-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:48 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 Apr 09 17:00:48 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:48 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" returned: 0 in 0.560s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.567s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-quobyte-b16e0005-fb4d-4479-81c6-174b36a39a1a-8e620c39-23bc-4222-bbfa-90b41717ee3d" by "_create_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aea814d-f254-489f-8754-81b3350c83c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7606a61b-554c-4433-870e-83371af08ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-b16e0005-fb4d-4479-81c6-174b36a39a1a-8e620c39-23bc-4222-bbfa-90b41717ee3d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Creating volume 8e620c39-23bc-4222-bbfa-90b41717ee3d from snapshot b16e0005-fb4d-4479-81c6-174b36a39a1a {{(pid=82139) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-quobyte-8e620c39-23bc-4222-bbfa-90b41717ee3d" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:48 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Volume volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f (2741b1ad-3a86-4aa2-be29-d4d83d7b027f): created successfully Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7606a61b-554c-4433-870e-83371af08ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Flow 'volume_create_manager' (81c99ee7-c489-4c3a-adab-711a27884a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:48 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-ed7d0044-a592-4a30-8570-af18007caa26 tempest-VolumeDependencyTests-1005108956 None] Created volume successfully. Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-8e620c39-23bc-4222-bbfa-90b41717ee3d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] snapshot: b16e0005-fb4d-4479-81c6-174b36a39a1a, volume: 8e620c39-23bc-4222-bbfa-90b41717ee3d, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f55bd5-e7f5-431f-9aac-9a23b7a91415]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:48 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a Apr 09 17:00:48 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:48 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308" returned: 0 in 0.581s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:48 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:48 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308 Apr 09 17:00:48 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:49 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a" returned: 0 in 0.531s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7856103d-d048-43e7-8b8b-d01385c2a54d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[156d59e1-5d0c-455a-ae48-bdb530132eff]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:49 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d Apr 09 17:00:49 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:49 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-3bed7f20-0d60-43c9-8641-b432e0cb4308" returned: 0 in 0.425s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-3bed7f20-0d60-43c9-8641-b432e0cb4308" released by "delete_volume" :: held 1.030s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created reservations ['0f08c9eb-68f5-4895-886a-9274bb4de105', '79f5bbac-07c6-46b6-b49f-b580e29a873a', '8c24f98f-ee67-49b9-a831-79e54c4d1f7c', 'dc3b4085-c972-4824-aaf8-c579b89702f8'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:49 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:49 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:49 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d" returned: 0 in 0.487s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:49 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d Apr 09 17:00:49 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Flow 'volume_create_manager' (2b95ceb9-7a82-4624-8a51-63f39e3c1b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0b35a5-7c1a-40db-b811-913d1b0ebc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0b35a5-7c1a-40db-b811-913d1b0ebc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1696943964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3276fd-2180-4d39-820c-2ae0c1bf6c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4e24f44f554a88acdffe585cc17db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2741b1ad-3a86-4aa2-be29-d4d83d7b027f,status='creating',terminated_at=None,updated_at=2026-04-09T15:00:50Z,use_quota=True,user_id='e276ea0d18034c469af0b8b7eb3a72b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03253d47-76b0-4394-8591-95eee66b3c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:49 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03253d47-76b0-4394-8591-95eee66b3c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593c975e-0716-4c54-ae31-a89365efb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:49 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Deleted volume successfully. Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593c975e-0716-4c54-ae31-a89365efb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bc3276fd-2180-4d39-820c-2ae0c1bf6c1d', 'volume_name': 'volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d', 'volume_size': 1, 'source_volid': '2741b1ad-3a86-4aa2-be29-d4d83d7b027f', 'source_volstatus': 'available'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf170aa-81aa-4498-93ef-0aca14a5965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf170aa-81aa-4498-93ef-0aca14a5965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a46c69d-3f76-4495-a5ca-0fd8d0dae4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:49 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Volume bc3276fd-2180-4d39-820c-2ae0c1bf6c1d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d', 'volume_size': 1, 'source_volid': '2741b1ad-3a86-4aa2-be29-d4d83d7b027f', 'source_volstatus': 'available'} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:49 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-907671a6-de39-4ea2-8c29-9e2e37fd1a23 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-3bed7f20-0d60-43c9-8641-b432e0cb4308-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-ff1831cc-0b23-40b4-bdd0-d8274b0f2389-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-ff1831cc-0b23-40b4-bdd0-d8274b0f2389-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-quobyte-ff1831cc-0b23-40b4-bdd0-d8274b0f2389" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:50 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-ff1831cc-0b23-40b4-bdd0-d8274b0f2389" acquired by "delete_volume" :: waited 0.019s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:50 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0022218d-4e2c-4e4f-b903-4eed5f63dc97]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:50 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:50 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 Apr 09 17:00:50 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:51 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389" returned: 0 in 1.182s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:51 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389 Apr 09 17:00:51 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:51 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d" returned: 0 in 2.074s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:51 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9351e9bf-71fc-4088-8adf-fa583438b37f]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:51 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:51 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d Apr 09 17:00:51 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:52 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff1831cc-0b23-40b4-bdd0-d8274b0f2389" returned: 0 in 0.403s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-ff1831cc-0b23-40b4-bdd0-d8274b0f2389" released by "delete_volume" :: held 1.621s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created reservations ['311b3c88-aa82-4939-9b7f-14272eaad864', '1f6d065e-45d3-41ea-83fe-baf72d0cae61', '72578dcb-fe42-4e66-81a0-01f47487da85', '77d30253-b286-4f0c-a732-0c80933b3433'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:52 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:52 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:52 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d" returned: 0 in 0.585s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:00:52 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Converted 1024.00 MB image at 493.47 MB/s Apr 09 17:00:52 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d is being set with open permissions: ugo+rw Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:52 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d Apr 09 17:00:52 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:52 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.389s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Deleted volume successfully. Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c3c59677-609d-4a9c-86f4-06cfdd9b1dec tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-ff1831cc-0b23-40b4-bdd0-d8274b0f2389-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:52 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d" returned: 0 in 0.413s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-8e620c39-23bc-4222-bbfa-90b41717ee3d" released by "_copy_volume_from_snapshot" :: held 4.152s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-b16e0005-fb4d-4479-81c6-174b36a39a1a-8e620c39-23bc-4222-bbfa-90b41717ee3d" released by "_create_volume_from_snapshot" :: held 4.183s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.206s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.892s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:52 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Cloning volume 2741b1ad-3a86-4aa2-be29-d4d83d7b027f to volume bc3276fd-2180-4d39-820c-2ae0c1bf6c1d Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-ff0cd2e7-a746-4498-8992-dccb49d1b6d6-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe1c6ef-12e3-405e-9d93-d4f5295d136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e620c39-23bc-4222-bbfa-90b41717ee3d', 'volume_size': 1, 'snapshot_id': 'b16e0005-fb4d-4479-81c6-174b36a39a1a'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71c6af5-9d6b-4c55-a523-d9f801e1d2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-ff0cd2e7-a746-4498-8992-dccb49d1b6d6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Creating offline snapshot 56ab3206-b43d-4a96-98e8-92c7ca7caa80 of volume 2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[8444f357-adee-475d-a2db-af321b0acb80]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:52 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Volume volume-8e620c39-23bc-4222-bbfa-90b41717ee3d (8e620c39-23bc-4222-bbfa-90b41717ee3d): created successfully Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71c6af5-9d6b-4c55-a523-d9f801e1d2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Flow 'volume_create_manager' (7ddde716-585d-46bb-9013-c5be70b0f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-quobyte-ff0cd2e7-a746-4498-8992-dccb49d1b6d6" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:52 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1d4bfb3d-0dda-41db-acaa-6a9938429de9 tempest-SnapshotDependencyTests-780334479 None] Created volume successfully. Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-ff0cd2e7-a746-4498-8992-dccb49d1b6d6" acquired by "delete_volume" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ce1f8-5cb3-4f9b-88dc-3885e2a89e52]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:52 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:52 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f Apr 09 17:00:52 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:52 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 Apr 09 17:00:52 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:53 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" returned: 0 in 0.476s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:53 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 1G Apr 09 17:00:53 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:53 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:53 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6 Apr 09 17:00:53 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-b16e0005-fb4d-4479-81c6-174b36a39a1a-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-b16e0005-fb4d-4479-81c6-174b36a39a1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-quobyte-7856103d-d048-43e7-8b8b-d01385c2a54d" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-7856103d-d048-43e7-8b8b-d01385c2a54d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-quobyte-b16e0005-fb4d-4479-81c6-174b36a39a1a" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-b16e0005-fb4d-4479-81c6-174b36a39a1a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Deleting offline snapshot b16e0005-fb4d-4479-81c6-174b36a39a1a of volume 7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] snapshot_file for this snap is: volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ca8058-a80d-4534-b2c0-6e6f47c7748e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:53 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a Apr 09 17:00:53 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:53 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 1G" returned: 0 in 0.484s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:53 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 Apr 09 17:00:53 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:53 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-ff0cd2e7-a746-4498-8992-dccb49d1b6d6" returned: 0 in 0.456s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-ff0cd2e7-a746-4498-8992-dccb49d1b6d6" released by "delete_volume" :: held 0.961s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created reservations ['fb64bbb2-b54f-4606-a27d-2e0af67e31d8', '5f2d2596-6433-448b-9cec-2aba0da859c2', '3c5cfb29-6563-4c38-9d2e-b3dd410d4a69', '8b19e101-de1a-44ce-bb75-bc76a191402c'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:53 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:53 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:53 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:54 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a" returned: 0 in 0.525s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7856103d-d048-43e7-8b8b-d01385c2a54d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[0381295b-29bb-4368-949a-bfe0e1e6dd97]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:54 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d Apr 09 17:00:54 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:54 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80" returned: 0 in 0.447s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:54 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 is being set with open permissions: ugo+rw Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:54 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 Apr 09 17:00:54 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:54 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.467s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:54 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Deleted volume successfully. Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-13c52ade-711b-48e2-bf66-6906585a0af9 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-ff0cd2e7-a746-4498-8992-dccb49d1b6d6-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:54 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d" returned: 0 in 0.483s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:54 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a Apr 09 17:00:54 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:54 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80" returned: 0 in 0.426s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:54 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.info Apr 09 17:00:54 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-8bb82d09-dd71-4227-8717-b6ebb094ee5c-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-8bb82d09-dd71-4227-8717-b6ebb094ee5c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-quobyte-8bb82d09-dd71-4227-8717-b6ebb094ee5c" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-8bb82d09-dd71-4227-8717-b6ebb094ee5c" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baabff1-d841-4313-8cd3-f82069a75aaa]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:54 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:55 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c Apr 09 17:00:55 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:55 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a" returned: 0 in 0.532s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:55 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a Apr 09 17:00:55 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:55 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.info" returned: 0 in 0.468s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:55 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.info is being set with open permissions: ugo+rw Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:55 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.info Apr 09 17:00:55 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:55 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:55 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c Apr 09 17:00:55 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:55 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d.b16e0005-fb4d-4479-81c6-174b36a39a1a" returned: 0 in 0.424s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:55 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.info" returned: 0 in 0.407s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" by "_copy_volume_from_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-b16e0005-fb4d-4479-81c6-174b36a39a1a" released by "_delete_snapshot" :: held 2.026s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-7856103d-d048-43e7-8b8b-d01385c2a54d" released by "delete_snapshot" :: held 2.040s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] snapshot: 56ab3206-b43d-4a96-98e8-92c7ca7caa80, volume: bc3276fd-2180-4d39-820c-2ae0c1bf6c1d, {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd1a95d-e51e-4551-a8ee-71203174aa85]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Created reservations ['b77c7c27-909a-4d2c-8f57-7dd3c4c4241b', '95897fbe-e5f2-48ca-9b8c-0787127e3bd1', 'a905d554-8357-4337-8984-aaddd438a6de', '3b6bb3aa-f89a-47e2-abff-e7255e68bfeb'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:55 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Delete snapshot completed successfully. Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-551129c3-8ef6-4428-b10d-622c2aea2984 tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-b16e0005-fb4d-4479-81c6-174b36a39a1a-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:55 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 Apr 09 17:00:55 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:55 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8bb82d09-dd71-4227-8717-b6ebb094ee5c" returned: 0 in 0.427s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-8bb82d09-dd71-4227-8717-b6ebb094ee5c" released by "delete_volume" :: held 0.926s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created reservations ['0ea96b27-585b-4320-ae06-921f4547d8c1', '69faddbc-016a-45ba-9ead-9148031d8469', '5021c334-e952-4373-b43f-21cc8d865bff', '25f8be89-bd0a-491e-bd7b-60c448e1fb9a'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:55 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:55 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:55 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-b1cb0b1a-99b6-484e-9ecd-4cc991469df8-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-b1cb0b1a-99b6-484e-9ecd-4cc991469df8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:56 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80" returned: 0 in 0.522s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Creating direct copy from snapshot {{(pid=82139) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3a14b0-8475-4b4e-bd5e-a5660375fdbc]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-quobyte-b1cb0b1a-99b6-484e-9ecd-4cc991469df8" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-b1cb0b1a-99b6-484e-9ecd-4cc991469df8" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64932df-1326-48fd-9a69-5f6c0a0a7cd6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:56 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f Apr 09 17:00:56 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:56 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 Apr 09 17:00:56 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:56 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.418s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:56 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Deleted volume successfully. Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-39e8c2f7-9775-453c-a1e3-0b19a2347cde tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-8bb82d09-dd71-4227-8717-b6ebb094ee5c-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:56 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" returned: 0 in 0.503s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.utils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Path /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d not found in is_blk_device check {{(pid=82139) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-7856103d-d048-43e7-8b8b-d01385c2a54d-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:56 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d Apr 09 17:00:56 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-7856103d-d048-43e7-8b8b-d01385c2a54d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-quobyte-7856103d-d048-43e7-8b8b-d01385c2a54d" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:56 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8" returned: 0 in 0.525s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-7856103d-d048-43e7-8b8b-d01385c2a54d" acquired by "delete_volume" :: waited 0.030s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:56 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8 Apr 09 17:00:56 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbabb750-1448-4734-afa8-faa84affc275]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:56 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:56 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d Apr 09 17:00:56 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:57 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-b1cb0b1a-99b6-484e-9ecd-4cc991469df8" returned: 0 in 0.769s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-b1cb0b1a-99b6-484e-9ecd-4cc991469df8" released by "delete_volume" :: held 1.318s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created reservations ['b74ced2d-0af6-4d4e-a802-1b6c6ffba8e5', 'd3db79d8-3f35-4177-9df3-21ff1e5aba25', '8499c2ce-2c83-4c80-8ecc-2578f7a0f48d', '34f79eca-11e7-4379-b2dd-682645b9b02b'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:57 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:57 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:57 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d" returned: 0 in 1.121s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:57 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:57 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d Apr 09 17:00:57 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "cinder-quobyte-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f" acquired by "delete_volume" :: waited 0.024s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[30429d31-5316-4280-94e6-12fe1fa5c1c7]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:58 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f Apr 09 17:00:58 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:58 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:58 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" returned: 0 in 2.193s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-7856103d-d048-43e7-8b8b-d01385c2a54d" returned: 0 in 0.970s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de3be51-4642-468d-a65b-eb84de0468e6]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-7856103d-d048-43e7-8b8b-d01385c2a54d" released by "delete_volume" :: held 2.129s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:58 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 1.185s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:58 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Deleted volume successfully. Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a2640c50-bb84-4cb8-a682-5a952621533b tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-b1cb0b1a-99b6-484e-9ecd-4cc991469df8-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Created reservations ['37a1a71f-b8dc-4f57-943e-f4fc09b9ead9', '95322e32-2a5b-4634-8be8-bcdc1f8d80d6', '55c564b0-b00f-4974-a688-2a112ecd419d', '562f2541-cc98-4fe5-a097-7be80fe6c756'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:58 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f Apr 09 17:00:58 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:58 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:58 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:58 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:59 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f" returned: 0 in 0.578s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:59 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f Apr 09 17:00:59 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:59 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.424s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:00:59 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Deleted volume successfully. Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-8aee0b90-9a24-417a-bc73-a92d9507f96e tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-7856103d-d048-43e7-8b8b-d01385c2a54d-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:59 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" returned: 0 in 0.606s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.image.image_utils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d {{(pid=82139) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:00:59 devstack cinder-volume[82139]: INFO cinder.image.image_utils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Converted 1024.00 MB image at 466.59 MB/s Apr 09 17:00:59 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d is being set with open permissions: ugo+rw Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:59 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d Apr 09 17:00:59 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:59 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f" returned: 0 in 0.440s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-quobyte-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f" released by "delete_volume" :: held 1.061s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Created reservations ['95f23d55-c3f3-4a05-95a6-e338a27fa528', 'a568d4cf-c932-4906-90e6-b2d68e396f90', '728acd21-d675-4b35-83aa-057c2bafdbc4', 'e5fa36b4-444b-45e4-8f7b-b4a7177cdeb0'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:59 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:00:59 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:00:59 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" returned: 0 in 0.435s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" released by "_copy_volume_from_snapshot" :: held 4.319s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-56ab3206-b43d-4a96-98e8-92c7ca7caa80" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-56ab3206-b43d-4a96-98e8-92c7ca7caa80" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Deleting offline snapshot 56ab3206-b43d-4a96-98e8-92c7ca7caa80 of volume 2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] snapshot_file for this snap is: volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dee184-690d-4eec-83ac-07faa3217540]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:00:59 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-8e620c39-23bc-4222-bbfa-90b41717ee3d-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-8e620c39-23bc-4222-bbfa-90b41717ee3d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "cinder-quobyte-8e620c39-23bc-4222-bbfa-90b41717ee3d" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:00 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-8e620c39-23bc-4222-bbfa-90b41717ee3d" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:00 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a3a2d8-3a2b-4f31-8a97-050dc430ff1f]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:00 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d Apr 09 17:01:00 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:00 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.478s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:01:00 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Deleted volume successfully. Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-616fd057-180c-4312-a808-79c06def0c92 tempest-CreateVolumesFromSourceVolumeTest-1000449774 None] Lock "cinder-bc9b0ab5-74eb-48cb-9f89-bbd2b0de131f-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:00 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80" returned: 0 in 0.601s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c6aed0-3c61-4550-b568-6a5024473204]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:00 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d" returned: 0 in 0.554s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:00 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:00 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d Apr 09 17:01:00 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:00 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f Apr 09 17:01:00 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:01 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-8e620c39-23bc-4222-bbfa-90b41717ee3d" returned: 0 in 0.448s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-quobyte-8e620c39-23bc-4222-bbfa-90b41717ee3d" released by "delete_volume" :: held 1.038s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:01 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" returned: 0 in 0.565s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Created reservations ['c9f5a1ef-98a8-417d-a1a5-cdf0172be7bc', '61faa79f-b0ce-4a4a-a6ae-4fc35e57150e', '750f7782-2803-41ac-8323-76fb4b7132a6', 'e8912395-116f-40de-acfd-dc335af77656'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:01:01 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 Apr 09 17:01:01 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:01 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:01:01 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Flow 'volume_create_manager' (a9eb8111-4ebb-4b68-a109-2267620cb248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d64d48-8b53-43f1-971d-8ecd8ea89cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d64d48-8b53-43f1-971d-8ecd8ea89cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e85caae2046453f9dc5b76ad65581ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:01:01Z,use_quota=True,user_id='554d75891a2846eea439913081aad746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcef40c6-4255-483f-b971-2644a8ed5028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcef40c6-4255-483f-b971-2644a8ed5028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ada1f3-63c9-49ad-ba6c-51358b375efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ada1f3-63c9-49ad-ba6c-51358b375efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea', 'volume_name': 'volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360281a9-7432-451a-9ef9-f49f3f7985a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360281a9-7432-451a-9ef9-f49f3f7985a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16590b28-a1a8-4498-a159-0240f9b3fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:01 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Volume 42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea', 'volume_size': 1} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:01 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80" returned: 0 in 0.484s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:01 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.451s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:01 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80 Apr 09 17:01:01 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:01:01 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Deleted volume successfully. Apr 09 17:01:01 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-9b498687-b0af-4c96-b160-73341f02d17a tempest-SnapshotDependencyTests-780334479 None] Lock "cinder-8e620c39-23bc-4222-bbfa-90b41717ee3d-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:02 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f.56ab3206-b43d-4a96-98e8-92c7ca7caa80" returned: 0 in 0.425s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-56ab3206-b43d-4a96-98e8-92c7ca7caa80" released by "_delete_snapshot" :: held 2.131s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.332s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e85caae2046453f9dc5b76ad65581ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:01:01Z,use_quota=True,user_id='554d75891a2846eea439913081aad746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Creating volume 42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:01:02 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a46c69d-3f76-4495-a5ca-0fd8d0dae4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d', 'volume_size': 1, 'source_volid': '2741b1ad-3a86-4aa2-be29-d4d83d7b027f', 'source_volstatus': 'available'}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:02 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea 1073741824 Apr 09 17:01:02 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c841fd0-6292-4d52-92d8-9b5fab02cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:02 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Volume volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d (bc3276fd-2180-4d39-820c-2ae0c1bf6c1d): created successfully Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c841fd0-6292-4d52-92d8-9b5fab02cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Flow 'volume_create_manager' (2b95ceb9-7a82-4624-8a51-63f39e3c1b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:01:02 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c1c40c89-adb7-4953-8c8a-291078ea4cde tempest-VolumeDependencyTests-1005108956 None] Created volume successfully. Apr 09 17:01:02 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea 1073741824" returned: 0 in 0.523s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:02 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea Apr 09 17:01:02 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-2741b1ad-3a86-4aa2-be29-d4d83d7b027f-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-2741b1ad-3a86-4aa2-be29-d4d83d7b027f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" acquired by "delete_volume" :: waited 0.007s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff394f9-5f23-454e-b705-1aa9df798eee]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:02 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:02 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f Apr 09 17:01:02 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:03 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea" returned: 0 in 0.455s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16590b28-a1a8-4498-a159-0240f9b3fff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb5a3c8-02e9-4276-986b-09bf84e9c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:03 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Volume volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea (42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea): created successfully Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb5a3c8-02e9-4276-986b-09bf84e9c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Flow 'volume_create_manager' (a9eb8111-4ebb-4b68-a109-2267620cb248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:01:03 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-f4df2c3a-f4bc-427f-9dbe-1ccdbf5f5b8d tempest-CinderUnicodeTest-1553659793 None] Created volume successfully. Apr 09 17:01:03 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" returned: 0 in 0.522s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:03 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f Apr 09 17:01:03 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:03 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" returned: 0 in 0.471s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-2741b1ad-3a86-4aa2-be29-d4d83d7b027f" released by "delete_volume" :: held 1.033s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Created reservations ['ef399905-d9ea-4d26-9477-506e2a0399ee', 'c4a56629-9b1d-4dcd-ac46-883a0dbf47b7', '82ce9f7c-9621-4842-a197-dd1bdf577c0a', '9f0b109d-c1f4-4341-8b8a-4129f169e9c2'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82139) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Flow 'volume_create_manager' (393ae2ec-3a1b-47a3-9380-199e4ff1646b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500e2e2e-62fb-4b6e-9aa9-4fe02ab7492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500e2e2e-62fb-4b6e-9aa9-4fe02ab7492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:01:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-227822783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e85caae2046453f9dc5b76ad65581ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:01:04Z,use_quota=True,user_id='554d75891a2846eea439913081aad746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1867e897-5921-4653-9e72-a19b163f9372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1867e897-5921-4653-9e72-a19b163f9372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8fc6d6-1b51-4f11-9744-21cabd102782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8fc6d6-1b51-4f11-9744-21cabd102782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5', 'volume_name': 'volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1d017c-0d2b-4ba5-9a62-722a7cfaeab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1d017c-0d2b-4ba5-9a62-722a7cfaeab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f58c19-68d0-4956-a840-42aec7e6b559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:03 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Volume 5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5', 'volume_size': 1} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:01:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-227822783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e85caae2046453f9dc5b76ad65581ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:01:04Z,use_quota=True,user_id='554d75891a2846eea439913081aad746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a6fcc9-2f9e-4ec2-a62d-5321574b2581),volume_type_id=72a6fcc9-2f9e-4ec2-a62d-5321574b2581)}" {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Creating volume 5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 {{(pid=82139) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Selected osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 as target Quobyte volume. {{(pid=82139) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:01:03 devstack cinder-volume[82139]: INFO cinder.volume.drivers.remotefs [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] casted to osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784 Apr 09 17:01:03 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 1073741824 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:04 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 1073741824 Apr 09 17:01:04 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:04 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:01:04 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:04 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.514s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:01:04 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Deleted volume successfully. Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-a1d60e44-dd69-4a56-95f9-d4386ba1cdb5 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-2741b1ad-3a86-4aa2-be29-d4d83d7b027f-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:04 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 1073741824" returned: 0 in 0.609s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:04 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 Apr 09 17:01:04 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:04 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b71f9-d5ae-45ec-87b0-0c4d2507197b]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:05 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d Apr 09 17:01:05 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:05 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" returned: 0 in 0.519s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'} {{(pid=82139) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f58c19-68d0-4956-a840-42aec7e6b559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5', 'volume_size': 1}' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d425e8-7716-46f7-88f9-f4f6864421ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:01:05 devstack cinder-volume[82139]: INFO cinder.volume.flows.manager.create_volume [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Volume volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 (5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5): created successfully Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d425e8-7716-46f7-88f9-f4f6864421ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82139) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Flow 'volume_create_manager' (393ae2ec-3a1b-47a3-9380-199e4ff1646b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82139) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:01:05 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-77a26112-b940-4d73-a15c-c5ee7864af91 tempest-CinderUnicodeTest-1553659793 None] Created volume successfully. Apr 09 17:01:05 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" returned: 0 in 0.510s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:05 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:05 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d Apr 09 17:01:05 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:06 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" returned: 0 in 0.469s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d" released by "delete_volume" :: held 1.002s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Created reservations ['db3210b1-e906-4c42-9503-2ceedaf65449', '0e00ffe3-f454-4607-bb07-fd961a8a796c', '21f58044-aca7-4227-aa62-56762a8d118e', '6eb7eb63-2a77-451b-8c76-b98581d4e32f'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:06 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:01:06 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Creating offline snapshot 3e90cd3e-5244-4dd7-b62a-bb948f4bf2de of volume 5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 {{(pid=82139) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[3248ca95-5ab9-4c7a-ae9e-878f3957ce5e]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:06 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 Apr 09 17:01:06 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:06 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.547s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:01:06 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Deleted volume successfully. Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-c8d357b8-fabf-46fe-99c2-2902b3d42513 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-bc3276fd-2180-4d39-820c-2ae0c1bf6c1d-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:06 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" returned: 0 in 0.531s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:06 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de 1G {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:06 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de 1G Apr 09 17:01:06 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-d526a831-493c-4382-8511-c79a144a1014-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-d526a831-493c-4382-8511-c79a144a1014-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "cinder-quobyte-d526a831-493c-4382-8511-c79a144a1014" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-d526a831-493c-4382-8511-c79a144a1014" acquired by "delete_volume" :: waited 0.012s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd80bbd-adaf-4673-a8a1-72d8f87e3a68]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:07 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de 1G" returned: 0 in 0.576s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:07 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de Apr 09 17:01:07 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:07 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 Apr 09 17:01:07 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:07 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 -F qcow2 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de" returned: 0 in 0.479s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:07 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de is being set with open permissions: ugo+rw Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:07 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de Apr 09 17:01:07 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:07 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014" returned: 0 in 0.573s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:07 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:07 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014 Apr 09 17:01:07 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:08 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de" returned: 0 in 0.482s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:08 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-d526a831-493c-4382-8511-c79a144a1014" returned: 0 in 0.473s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-quobyte-d526a831-493c-4382-8511-c79a144a1014" released by "delete_volume" :: held 1.078s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:08 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.info Apr 09 17:01:08 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Created reservations ['0866a087-0407-4106-a1e7-2cae1117634d', 'aa055f86-16c1-4f49-bf0c-22fd2a68b0bd', '620456e8-b059-413c-af02-2bd75a8024b9', '18db121d-f338-4ddc-80e5-55cc9fd908c7'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:08 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:01:08 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:08 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.info" returned: 0 in 0.424s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:08 devstack cinder-volume[82139]: WARNING cinder.volume.drivers.remotefs [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.info is being set with open permissions: ugo+rw Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.info {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:08 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.info Apr 09 17:01:08 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:08 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.399s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:01:08 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Deleted volume successfully. Apr 09 17:01:08 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3cfa24be-1488-4a41-a104-114bb1d6ec87 tempest-VolumeDependencyTests-1005108956 None] Lock "cinder-d526a831-493c-4382-8511-c79a144a1014-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:09 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.info" returned: 0 in 0.415s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:09 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-97118c82-aeaf-4675-85e0-68594ccee8fe tempest-CinderUnicodeTest-1553659793 None] Create snapshot completed successfully Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "cinder-3e90cd3e-5244-4dd7-b62a-bb948f4bf2de-delete_snapshot" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-3e90cd3e-5244-4dd7-b62a-bb948f4bf2de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "cinder-quobyte-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" by "delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-quobyte-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "cinder-quobyte-3e90cd3e-5244-4dd7-b62a-bb948f4bf2de" by "_delete_snapshot" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-quobyte-3e90cd3e-5244-4dd7-b62a-bb948f4bf2de" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Deleting offline snapshot 3e90cd3e-5244-4dd7-b62a-bb948f4bf2de of volume 5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] snapshot_file for this snap is: volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de {{(pid=82139) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ff30c6-8c3d-4a70-887e-37b3637d624f]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:09 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de Apr 09 17:01:09 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:09 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de" returned: 0 in 0.523s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.remotefs [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82139) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e6bf95-33fb-4a54-aa13-972f6c10675a]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:09 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 Apr 09 17:01:09 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:10 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" returned: 0 in 0.537s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:10 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de Apr 09 17:01:10 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:10 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de" returned: 0 in 0.429s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:10 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:10 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de Apr 09 17:01:10 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:11 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5.3e90cd3e-5244-4dd7-b62a-bb948f4bf2de" returned: 0 in 0.396s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-quobyte-3e90cd3e-5244-4dd7-b62a-bb948f4bf2de" released by "_delete_snapshot" :: held 1.951s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-quobyte-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" released by "delete_snapshot" :: held 1.963s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Created reservations ['6341c143-cf16-4355-ba78-fc9f9341f9cf', 'e0c7e13a-5e92-4c9a-81f1-5edbbb0a000d', '9c59c172-4bf1-41e9-9c36-2e42781773ac', 'b3877fb5-edc5-4c19-9336-628735343e7d'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:01:11 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Delete snapshot completed successfully. Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-3ec6e37e-bc0a-41e9-867b-1e5429a783f5 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-3e90cd3e-5244-4dd7-b62a-bb948f4bf2de-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "cinder-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "cinder-quobyte-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-quobyte-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" acquired by "delete_volume" :: waited 0.006s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[54826542-4f59-4a15-a5d0-855fafcd5f52]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:11 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 Apr 09 17:01:11 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:11 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" returned: 0 in 0.447s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:11 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:11 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5 Apr 09 17:01:11 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:12 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" returned: 0 in 0.399s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-quobyte-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5" released by "delete_volume" :: held 0.880s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Created reservations ['72e0b015-2910-473e-8882-4d4d385c0e75', '61d243f5-47a1-492a-866a-a700d01f180e', '2d681dea-a67a-4464-b242-c91d2c4f499f', '3ca78456-f29e-4395-987c-2729fdde52b5'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:12 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:01:12 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "cinder-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea-delete_volume" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "cinder-quobyte-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea" by "delete_volume" {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-quobyte-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea" acquired by "delete_volume" :: waited 0.018s {{(pid=82139) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0dd57d-b710-42d0-8c3b-d460b4cee933]: (4, 'qcow2') {{(pid=82970) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:12 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea Apr 09 17:01:12 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:12 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.421s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:01:12 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Deleted volume successfully. Apr 09 17:01:12 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-4b1a6278-4a89-4a22-9425-b75b0a061d43 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-5e855a0e-c68a-4bf4-bf1b-714afd4fc4d5-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:13 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea" returned: 0 in 0.472s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:13 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea Apr 09 17:01:13 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:13 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20/volume-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea" returned: 0 in 0.397s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-quobyte-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea" released by "delete_volume" :: held 0.888s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG cinder.quota [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Created reservations ['9dd7a471-29cc-47da-b9ab-8cafdc27b2a2', '73415fea-cc86-4861-846e-b63f6e03bbc5', '132edeac-6368-43f5-9287-b154870f37f0', 'c6a26222-0965-4a8e-8a95-daa6a9b1b2d2'] {{(pid=82139) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:13 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:13 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:01:13 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:14 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.429s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:01:14 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Deleted volume successfully. Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG cinder.coordination [None req-1a913b92-bbdd-4cab-9974-28b40fb972b6 tempest-CinderUnicodeTest-1553659793 None] Lock "cinder-42a0bd00-6e4a-4ed3-b5ba-4ceee5ea5aea-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=82139) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG oslo_service.periodic_task [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82139) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784': None} {{(pid=82139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG cinder.volume.drivers.quobyte [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87bc6d20-4abd-4a28-ace4-3c7e4a952784'] {{(pid=82139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82139) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:01:14 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20 Apr 09 17:01:14 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:01:14 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG oslo_concurrency.processutils [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d3d16f29312a203c9686fce0acc1d20" returned: 0 in 0.486s {{(pid=82139) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:01:14 devstack cinder-volume[82139]: DEBUG cinder.manager [None req-c9f57027-66be-41f3-823c-e23e7ab1a45b None None] Notifying Schedulers of capabilities ... {{(pid=82139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:01:23 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:UPDATE=276,cinder:DELETE=25,cinder:SELECT=205,cinder:INSERT=83 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:01:24 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writing DB stats cinder:SELECT=194,cinder:INSERT=55,cinder:UPDATE=287,cinder:DELETE=23 {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}